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FOREWORD 


This  report  documents  the  results  of  efforts  conducted 
under  Contract  No.  F33615- 77 -C- 3079  with  the  Air  Force  Flight 
Dynamics  Laboratory,  Wr ight - Pat terson  Air  Force  Base. 

Mr.  Jim  Guckian  was  the  Project  Monitor.  This  effort  was 
conducted  under  Project  2403,  "Flight  Control  Technology," 
Task  240302,  "Flight  Control  Systems  Development,"  Work  Unit 
2405-02-37,  "Flight  Control  Law  Design/Val idat ion . " 


This  investigation  was  performed  during  the  period  from 
September  1977  to  September  1978,  and  the  report  was  submitted 
to  AFFDL  in  October  1978. 
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SECTION  I 
INTRODUCTION 


1.  BACKGROUND 


The  path  control  problem,  namely,  the  command  and  control  of 
an  aircraft  to  follow  a reference  path,  occurs  frequently  in 
the  design  of  modern  flight  guidance  and  control  systems.  The 
problem  is  two-fold:  (1)  generating  the  reference  path  to 
satisfy  various  navigation,  guidance  or  other  "outer  loop"  con- 
trol objectives  such  as  performance  optimization,  and  (2)  fol- 
lowing the  reference  path  while  simultaneously  satisfying  "inner- 
loop"  control  objectives  such  as  disturbance  rejection  and  in- 
sensitivity to  vehicle  parameter  variations. 

As  will  be  demonstrated  in  this  report,  many  aspects  of 
aircraft  guidance  and  control  can  be  (.and  historically  have  been) 
formulated  in  this  path  control  framework,  which  is  illustrated 
in  Figure  1.  Referring  to  the  figure,  the  path  control  frame- 
work consists  of  two  parts:  (1)  a "reference  generator"  which 
defines  reference  trajectories  and  nominal  control  commands 
that  satisfy  outer-loop  control  objectives,  and  (2)  a "perturb- 
ation controller"  which  effects  a perturbation  control  that 
satisfies  inner-loop  control  objectives.  The  nominal  control 
and  perturbation  control  are  then  summed  to  yield  the  total 
control  command  which  is  sent  to  the  control  actuators. 

Several  factors  work  together  to  heighten  the  importance  of 
the  path  control  problem  and  to  diversify  the  ways  in  which  it 
appears.  As  illustrated  in  Figure  2,  changing  Air  Force  mission 
requirements  and  the  advent  of  Control  Configured  Vehicle  (CCV) 
technology  have  had  a profound  influence  on  the  requirements 
for  both  outer  loop  and  inner  loop  control  design.  At  the  same 
time,  advances  in  the  capabilities  for  on-board  processing  have 
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improved  the  "implementabilitv"  of  sophisticated  designs.  The 
interrelationship  of  these  factors  is  discussed  below. 

Air  Force  mission  requirements  have  evolved  to  encompass 
the  flying  of  complex  trajectories  to  improve  the  effective- 
ness and  safety  of  tactical  operations,  such  as  rendezvous 
for  refueling  or  aerial  delivery  (t ime- of - arrival  guidance) 
and  minimizing  exposure  to  the  enemy  (terrain  following, 
threat  avoidance) . Synthesis  of  the  required  complex  tra- 
jectories can,  in  many  cases,  be  viewed  directly  as  the 
reference  generation  portion  of  the  path  control  problem. 

Further,  the  Air  Force,  as  well  as  civil  aviation,  is 
increasingly  aware  of  energy  efficiency.  Consequently,  much 
effort  has  been  directed  towards  fue 1 - economic  operations. 

In  the  context  of  "outer  loop"  control,  several  techniques 
have  been  applied  to  generate  reference  paths  which  optimize 
fuel  consumption  by  managing  the  aircraft's  energy  state.  Fuel 
optimization  can  also  be  addressed  at  the  inner  control  loop. 

For  example,  the  presence  of  direct  lift  control  provides  an 
additional,  redundant  means  of  regulating  aircraft  pitch-plane 
motion;  consequently,  a path - fol lowing  controller  for  this 
application  may  well  be  designed  to  follow  its  reference  while 
simultaneously  attempting  to  optimize  the  thrust  control  level. 

Direct  lift  control  and  other  automated  techniques  which 
aim  at  augmenting  the  basic  stability,  handling  qualities,  and 
performance  characteristics  of  aircraft  fall  into  the  general 
category  of  CCV  technology.  The  key  idea  of  CCV  technology 
is  the  integration  of  control  with  aerodynamics,  structures, 
and  propulsion  early  in  the  design  cycle  of  the  aircraft. 

Studies  have  shown  that  significant  reductions  in  induced  drag 
and  structural  weight  and  reduction  of  flight  hazards  can  be 
achieved  with  such  active  controls  [1],  These  benefits  are  possible 
due  to  (1)  a reduction  in  the  sizes  of  stabilizing  surfaces, 
with  stability  provided  by  dynamically  controlling  movable 
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surfaces  rather  than  statically  with  large  fixed  surfaces  as  in 
the  conventional  designs;  (2)  reductions  in  structural  strength 
requirements  (and  hence  weight)  by  applying  maneuver  load  allev- 
iation and  gust  load  alleviation;  and  (3)  reduction  in  the 
occurrence  of  inadvertent  flight  hazard  through  automatic 
limitation  of  flight  conditions.  Many  of  the  objectives  of  these 
active  controls  can  be  expressed  as  additional  performance 
criteria  and  design  constraints  for  the  path- following  portion 
("inner  loop")  of  the  path  control  system. 


A very  important  example  of  how  Air  Force  mission  require- 
ments and  CCV  technology  relate  to  the  path  control  problem 
is  the  recent  work  [2,3]  aimed  at  providing  aircraft  (YC-14, 
YC-1S,  and  various  NASA  research  aircraft)  capable  of  short 
take-off  and  landing  (STOL).  The  STOL  investigations  are 
developing  powered- lift  technology,  exploring  such  concepts 
as  the  augmentor  wing,  lift  fan,  and  externally  blown  flap. 

These  concepts  all  achieve  the  necessary  wide  range  of  lift 
coefficient  by  means  of  in-flight  modif ications  to  the  aircraft 
configuration.  Such  modifications  result  in  extreme  changes 
in  the  control  characteristics  of  the  aircraft  in  the  transition 
from  cruising  flight  to  the  high-lift  landing  configuration. 

• For  the  STOL  problem,  the  path  generation  function  must 

satisfy  the  typically  more  stringent  short-field  landing  per- 
formance requirements,  in  terms  of  minimum  dispersions  in  the 
vicinity  of  the  touchdown  point.  Synthesis  of  the  reference 
path  must  also  contend  with  the  changes  in  aircraft  character- 
istics associated  with  transitions  in  the  aircraft  configur- 
ation. The  design  of  the  inner  loop  (or  path- fol lowing  or  "per- 
turbation") controller  is  also  affected  by  these  transitions  in 
that  the  aircraft  response  to  controls  over  the  full  flight 
envelope  is  very  nonlinear.  Moreover,  the  presence  of  powered- 
and  direct-lift  generators  increases  the  total  number  of 


controls  available  to  the  pilot*  who  must  continually  make 
decisions  on  control  techniques.  Accurate,  unaided,  manual 
tracking  of  complex  trajectories  by  manipulating  a large  set 
of  interacting  controls  of  an  aircraft  whose  control  character- 
istics are  nonlinear  and  rapidly  changing  represents  an  unaccept- 
ably high  pilot  workload  [1].  Thus,  the  path - fo 1 lowing  portion 
of  the  control  system  is  tasked  with  automatic  resolution  of 
ambiguous  controls  and  the  maintenance  of  acceptable  and  consis- 
tent handling  qualities,  in  addition  to  stringent  tracking  of 
its  input  commands. 

Of  course,  the  scale  of  CCV  technology  would  have  been 
severely  restrained  had  it  not  been  for  the  rapidly  advancing 
technology  of  electronics  and  especially  airborne  computing . 
Modern  flight  control  systems  are  capable  of  substantial 
reliability  requirements  associated  with  active  controls,  many 
of  which  are  critical  to  flight  safety.  Computation  resource 
is  vital  to  imp lemen tat iona 1 feasibility  of  path  control  systems. 
The  generation  of  reference  paths,  for  example,  typically  re- 
quires the  solution  of  an  optimization  problem  (minimum  fuel, 
minimum  time,  etc.)  over  a wide  range  of  flight  conditions  and 
subject  to  numerous  constraints.  Such  a reference  solution 
can  be  very  resource  consuming,  depending  strongly  on  the  problem 
addressed  and  the  numerical  methods  used.  Fortunately,  the 
dynamics  of  the  outer  (reference)  solution  are,  in  general, 
relatively  slow;  consequently,  a reduced  iteration  interval 
can  usually  be  employed  for  the  reference  solution,  thus 
spreading  the  process ing  over  a number  of  basic  computational 
cycles.  Such  implementat ional  considerations  will  be  discussed 
in  this  report  as  appropriate  in  the  context  of  path  control. 


* Typ ica . ly , the  pilot  will  intervene  to  provide  the  outer-loop/ 
inner-loco  interface  for  such  sensitive  STOL  operations  as 
the  transition,  landing,  and  take-off  phases. 


SCOPE 


The  preceding  discussion  has  pointed  out  the  diversity  of 
control  objectives  which  impact  the  design  of  modern  flight 
control  systems.  To  meet  these  objectives,  there  has  been  a 
proliferation  of  analytic  methods  and  design  approaches, 
exhibiting  varying  degrees  of  success  and  practicality.  Some 
problem  areas  have  received  a great  deal  of  attention;  others 
have  received  very  little. 

The  purpose  of  this  report  is  to  unify  design  concepts 
for  modern  flight  guidance/control  systems,  to  compare  design 
methods  as  to  their  applicability  and  promise,  and  to  identify 
areas  toward  which  future  research  should  be  directed.  In  order 
to  provide  a basis  for  the  unification  of  concepts,  the 
report  casts  a number  of  typical  aircraft  mission  requirements 
and  control  design  objectives  in  the  framework  of  the  path 
control  problem.  In  this  context,  design  methods  are  reviewed 
for  both  reference  (trajectory)  generation  and  path - fol lowing 
(perturbation)  control,  and  a number  of  illustrative  examples 
are  presented.  The  report  does  not  include  rigorous  derivations 
of  the  design  methods;  rather,  the  emphasis  is  on  the  basic 
principles  behind  the  methods  and  their  applicability  to  the 
various  facets  of  the  path  control  problem.  Where  appropriate, 
computational  requirements  and  design  constraints  are  also 
discussed. 

The  remainder  of  this  report  is  organized  as  follows. 
Section  II  presents  an  overview  of  control  system  design 
objectives,  constraints,  and  methods.  The  role  of  system  model- 
ing in  the  design  process  is  discussed,  and  a fairly  comprehen- 
sive development  of  system  modeling  techniques  is  presented. 
Section  III  defines  the  path  control  generic  structure  and 
identifies  ways  in  which  broad  design  problems  are  decomposed 
and  partitioned  to  conform  to  this  framework.  The  reference 
generation  and  perturbation  (path- fol lowing)  portions  of  the 
path  control  problem  are  then  discussed  separately.  Section  IV 
presents  conclusions  and  recommendations  for  future  work. 
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SECTION  II 

CONTROL  SYSTEM  DESIGN  OVERVIEW 


1.  INTRODUCTION 


Control  of  modern,  complex  flight  systems  is  a broad  and 
multifaceted  problem.  The  flight  control  system  must  provide 
for  safe  and  efficient  accomplishment  of  the  control  objectives 
At  the  highest  level,  these  control  objectives  might  be  des- 
cribed as  any  one  or  combination  of  the  following,  among  others 

• Control  of  along-path  or  terminal  errors 

• Economic  control  of  time,  fuel,  or  energy  expenditure 

• Achieving  or  maintaining  a desired  separation  distance 
(e.g.  in-flight  refueling) 

• Achieving  a desired  terminal  state  (altitude,  velo- 
city, etc.) 

• Avoiding  hazardous  obstacles,  terrain,  or  threat 
contours 

At  the  middle  and  lower  levels,  control  objectives  address  such 
related  issues  as: 

• Augmentation  of  the  basic  stability  characteristics 
of  the  aircraft 

• Enhancement  of  the  aircraft's  flying  qualities 

• Alleviation  of  structural  loads 


• Limiting  the  flight  envelope  to  exclude  hazardous 
flight  conditions 

In  meeting  the  varied  and  sometimes  conflicting  control 
objectives,  the  flight  control  system  must  deal  with  many  con- 
straints and  limitations.  Among  these  are: 

• Computational  constraints  (speed  and  memory  sizing) 
for  computerized  control  algorithms 
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• Practical  limitation  of  size  of  aerodynamic  surfaces 
and  the  effectiveness  of  associated  actuators 

• Practical  limitation  of  the  number,  type,  and  place- 
ment of  motion  sensors 

• Performance  constraints  of  the  man/vehicle  system 

Many  methods  have  been  applied  to  the  design  of  systems 
to  meet  the  above-mentioned  aircraft  control  objectives  in 
the  face  of  the  indicated  constraints  and  limitations.  These 
can  be  loosely  categorized  as  classical  and  modern  techniques. 
Classical  techniques  are  normally  associated  with  s ingle- input/ 
single-output  transfer  functions  and  design  in  the  frequency 
domain;  modern  techniques  are  characterized  by  design  in  the  time 
domain  (state-space  system  description)  and  the  optimization  of 
a multifaceted  performance  criterion.  Although  certainly  not 
mutually  exclusive,  classical  techniques  have  historically  been 
applied  to  the  middle  and  lower  level  (inner  loop)  control 
objectives  cited  above;  the  higher  level  (outer  loop)  objectives 
have  normally  been  addressed  by  modern  optimization  techniques. 
These  various  design  methods  are  described  in  more  detail  in 
subsequent  sections. 

Common  ground  for  both  classical  and  modern  design  methods 
is  their  reliance  on  a mathematical  model  of  the  aircraft 
and  its  environment.  Such  a model  plays  a central  role  in  the 
design  of  flight  control  systems,  as  illustrated  in  Figure  3. 

As  shown,  the  model  is  used  not  only  for  design  of  the  control 
system  itself,  but  also  to  aid  in  the  evalution  of  the  resulting 
design.  The  model  serves  as  the  basis  for  off-line  simulation  of 
the  controlled  process  and  evaluation  of  the  flight  control 
system  in  this  simulated  environment.  The  simulation  includes, 
in  addition  to  the  control  algorithms  themselves,  detailed 
models  of  the  significant  aircraft  systems  and  environmental 
conditions.  Such  simulator  models  are  typically  of  a higher 


8 


Figure  3.  Utilization  of  Mathematical  Models  in  the 
Flight  Control  System  Design  Process 

degree  of  fidelity  (or  completeness)  than  those  more  simplified* 
versions  which  are  normally  used  for  control  design.  The  simu- 
lation may  well  include  pieces  of  the  actual  flight  hardware 
subsystems  in  place  of  certain  mathematical  submodels;  in  some 
cases,  a complete  cockpit  mockup  is  included.  As  also  illus- 
trated in  Figure  3,  the  model  is  used  additionally  to  plan  and 
direct  experimental  test  and  validation  activities.  Exercising 
the  model  in  a simulated  environment  can  indicate  sensitive 
aspects  of  the  controller/vehicle  system  design,  so  that  test 
activities  can  be  directed  towards  these  sensitive  areas. 
Analysis  of  the  test  data  has  the  dual  purpose  of  evaluating 
the  performance  of  the  control  system  design  and  also 

* Such  simplifications  to  a sophisticated  model  may  be 

necessary  in  order  to  achieve  a practically  implementable 
solut  ion . 
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validating  the  models  upon  which  the  design  is  based,  for 
example,  by  statistical  identification  of  the  model's  parameters 
from  test  data.  Considering  the  pervasive  importance  of  mathe- 
matical modeling,  the  modeling  of  systems  and  its  relationship 
to  the  control  design  process  is  the  subject  of  the  next  section. 


2. 


SYSTEM  MODELING 


A mathematical  model  of  the  physical  system  describes 
the  behavior  of  the  system  in  terms  of  mathematical  laws 
of  physics  and  geometry,  involving  such  time-varying  quantities 
as  acceleration,  velocity,  position,  attitude,  etc.  The  realm 
of  system  mathematical  modeling  is  quite  broad.  However,  for 
aircraft  guidance  and  control  design  purposes,  the  scope  can 
almost  always  be  narrowed  to  finite-dimensional  systems,  which 
means  that  the  system  under  consideration  can  be  described  by 
a finite  number  of  time-varying  quantities  (variables). 

Moreover,  the  systems  to  be  addressed  are  of  the  lumped,  con- 
tinuous time  type,  which  means  that  they  can  be  modeled  in  terms 
of  ordinary  differential  equations.* 

The  differential  equations  which  represent  aircraft  motion 
are  well  known  [4],  having  their  basis  in  Newton's  laws  (force 
equilibrium)  and  the  Euler  equations.  Further  principles  of 
Newtonian  mechanics  are  used  to  generate  equations  which  relate 
to  the  energy  state  of  the  aircraft.  In  some  cases,  empirical 
methods  may  be  required  to  establish  certain  functional  relation- 
ships or  to  quantify  parameters  in  the  equations  which  constitute 
the  mathematical  model. 


* The  basic  concepts  developed  here  apply  also  to  discrete 
time  systems,  such  as  systems  with  measurements  at  discrete 


times  and/or  with  control  changes  at  discrete  times,  and  to 
distributed  systems,  such  as  systems  with  elastic  components. 


10 


a.  Nonlinear  System  Model 


Once  established  from  the  laws  of  physics  and  geometry, 
the  generally  nonlinear  equations  of  motion  can  be  written  in 
the  state-space  form  using  vector  notation: 


X = f(x,u,t) 

(1) 

y = &(x,u,t) 

(2) 

where 

x is  the  nxl  vector  of  dependent  variables,  or  state 
vector 

£ is  an  nxl  vector  operator  which  describes  the 
"evolution"  (movement)  of  the  state 

u is  the  mxl  vector  of  controllable  variables,  or 
control  vector 

v is  the  rxl  vector  of  measurable  or  output  variables 

g is  the  rxl  vector  operator  which  relates  the  system 
outputs  (measurements)  to  the  states  and  controls 

t is  the  time,  the  independent  variable 

Equation  (1)  is  called  the  "state"  (or  "evolution")  equation; 

Eq.  (2)  is  called  the  "measurement"  (or  "output")  equation. 

The  mathematical  model  of  the  physical  process  is  illustrated 
in  Figure  4.  The  tip  of  the  state  vector  describes  the  state 
"trajectory,"  as  illustrated  in  Figure  5.  Physical  require- 
ments usually  yield  a continuous  trajectory,  even  though  the 
control  u(t)  may  be  discontinuous  or  occur  at  discrete  in- 
stants, as  in  the  case  of  a digitally  controlled  process. 

For  modeling  aircraft  dynamics,  the  state  equation  is  so 
formulated  as  to  encompass  all  significant  aerodynamic  modes  [4]. 


In  addition,  actuator  and  sensor  dynamics , if  significant, 
can  be  absorbed  into  the  state  equation. 

b.  Reference  Trajectory 

Having  arrived  at  the  best  available  system  model  (Eqs. 

Cl),  (2)3,  the  next  logical  step  is  to  determine  the  ideal 

(or  nominal)  control  u (t)  which  will  induce  the  desired 

ideal  (or  nominal)  behavior  of  the  svstem  state  x (t).  Formally, 

— o 

the  reference  (or  nominal)  trajectory  is  described  by: 

io(t}  = > t)  (3) 

Xo (t)  = £(^(1)  , uQ(t)  , t)  i4) 

The  reference  trajectory  and  control  may  be  obtained  in  a 
number  of  ways,  ranging  from  various  ad  hoc  methods  (trial-and- 
error  computer  runs,  geometric  fitting  of  curves  through  "way- 
points,"  etc.)  to  sophisticated  optimization  procedures 
(calculus  of  variations,  numerical  iterative  techniques  such 
as  gradient  methods  or  differential  dynamic  programming,  etc.). 
Section  III  provides  some  examples  of  reference  generation  for 
aircraft  guidance  and  control  problems. 

Unfortunately,  the  ideal  reference  control,  when  input 

into  the  real  physical  system,  will  not,  in  general,  exactly 

produce  the  ideal  trajectory;  i.e.  setting  the  real  control 

u(t)  equal  to  the  calculated  ideal  u (t)  will  not  vield  a 
~ ~o 

true  state  trajectory  x(t)  which  is  identically  equal  to 
the  ideal  x (t)  for  all  t in  the  interval  of  interest.  The 
reason  is  that  xQ(t)  and  yQ(t)  were  computed  using  a mathe- 
matical model  of  the  physical  process.  However,  the  engineer 
has  to  make  some  approximations  (sometimes  intentionally)  to  arrive 
at  the  mathematical  model,  often  neglecting  to  include  second- 
order  effects.  Even  if  the  equations  were  exact  structurally, 


the  values  of  the  parameters  used  in  the  mathematical  model  are 

nominal  ones  and  the  true  values  may  be  slightly  different.  In 

addition,  the  actual  initial  state  of  the  system  x(tQ)  may 

differ  slightly  from  the  ideally  assur  one  x^t  ).  It 

then  follows  that  errors  in  the  deterministic  model  may 

by  themselves  contribute  to  deviations  of  the  true  physical 

plant  state  x(t)  from  its  ideal  deterministic  one  x^(t)  . 

In  fact,  small  initial  deviations,  caused  by  the  difference 

x(t  ) -x  (t  ),  may  get  worse  and  worse  as  time  goes  on  [5]. 

— O — 0 o 

In  order  to  deal  with  these  deviations,  one  looks  at  the  be- 
havior of  the  model  in  the  "neighborhood"  of  the  reference 
trajectory. 

c.  Linear  System  Model 

The  behavior  of  the  model  in  the  neighborhood  of  the 
reference  trajectory  is  described  by  linear  "perturbation  equa- 
tions." If  the  reference  trajectory  is  truly  optimal,  then  the 
perturbation  equations  contain  information  as  to  how  the  model 
could  best  be  driven  back  to  the  original  trajectory  (for  example) 
after  having  been  perturbed  away  from  the  reference  trajectory. 

The  perturbation  concept,  illustrated  in  Figure  6,  is  evident 
in  the  following  definitions: 

i$x (t)  = x(t)  - x (t)  : perturbation  state  vector 

— — — o 

<5y  (t)  e y(t)  - y (t)  : perturbation  measurement 

~ ~°  vector 

5u(t)  = u(t)  - u^Ct):  perturbation  control  vector 

The  linear  system  model  emanates  from  the  perturbation 
concept  by  expanding  the  state  and  measurement  equations 


ACTUAL  TRAJECTORY 


x(t) 


Figure  6.  The  Actual  and  Reference  Trajectories,  and 
the  Perturbation  State  <5x(t) 


about  the  reference  values  (x^t)  and  uQ(t))  in  a Taylor 
Series : 

9 f | 

f(x(t))  ,u(t))  = f (^(t)  ,uo(t))  + 5x(t) 


3f  | 

+ aU  I 6H(t)  + Oo(6x(t)  ,6u(t)  ) (: 


£(x(t),u(t))  =H(xo(t),uo(t))  + — 


6x(t)  + an  ( t: ) 


+ ^(ixCt)  ,6u(t) ) (( 

where  the  vector  functions  and  represent  the  higher 

order  terns  in  the  series  expansion.  If  the  nominal  is  sub- 
tracted from  the  above  equations  and  the  higher  order  terms 
and  Qq  are  neglected,  the  linear  system  model  results: 


<5x(t)  = A ( t ) 6x  ( t ) + B(t)6u(t) 
5v(t)  = C(t)5x(t)  ♦ D(t)6u(t) 


(7 

(8 


where 


A (. t ) is  the  nxn  state  matrix  (9f/9x)  evaluated  along 
the  reference  trajectory  at  xQ(t)  and  u^tt) 

B (, t ) is  the  nxm  control  matrix  (9f/9u)  evaluated 

at  x = x , u = u 
— — o — -o 

C(tj  is  the  rxn  state  measurement  matrix  (9g/9x) 

evaluated  at  x = x , u = u 

— — o — — o 

D C t ) is  the  rxm  control  measurement  matrix  (9g,/9u) 

evaluated  at  x = x , u = u 

— — o — — o 

The  structure  of  the  linear  system  model  is  depicted  in  Figure 


In  general,  the  matrices  of  partial  derivatives  A,  B,  C, 
and  D must  be  calculated  along  the  reference  traiectory;  i.e. 
the  elements  of  the  matrices  are  functions  of  the  reference 
state  and  reference  control.  The  system  is  thus  time  varying 
(.or  nonautonomous)  . For  certain  classes  of  systems,  it  may  he 
permissible  to  assume  these  matrices  to  be  constant  over  the 
region  and  time  interval  of  interest.  In  this  case,  the  system 
is  classified  as  time  invariant,  and  the  coefficients  of  the 


Figure  7.  Structure  of  the  Linear  (Perturbation)  Model 
of  a Physical  Process 
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linear  differential  equations  represented  by  Fqs.  (7)  and  (3) 
become  constant.  The  constant  coefficient  differential  equa- 
tions are  amenable  to  the  transform  methods  which  are  critical 
to  classical  design  approaches. 

d.  Reduced  Order  Modeling 


t 


For  the  purpose  of  simply  predicting  or  ''simulating"  state 
trajectories,  state  models  of  high  dimensionality  (n  % 30  or 
more)  are  well  within  the  computational  capabilities  of  modern 
large-scale  computing  systems.  However,  as  a rule,  control 
system  design  methods,  both  classical  and  modern,  rapidly 
become  unwieldy  as  system  dimension  increases.  For  this 
reason,  much  attention  has  been  given  to  the  reduction  of  model 
order.  It  should  be  noted  that  controllers  designed  using  a 
reduced- order  model  will  be  subopt imal . The  performance  of  such 
suboptimal  controllers  must  be  evaluated,  generally,  in  a high- 
fidelity  simulation  to  determine  whether  the  reduced-order  de- 
signs are  acceptable. 

The  following  outlines  some  of  the  more  successful  methods 
of  reduced- order  modeling.  Specific  examples  will  be  given  in 
subsequent  sections. 

(1)  Neglecting  Subsystems 

The  most  basic  form  of  model  order  reduction  is 
simply  ignoring  certain  subsystems  whose  states  are  either  not 
observable  or  not  controllable.  An  example  of  this  is  the 
neglecting  of  bending  modes  whose  natural  frequencies  are 
beyond  the  control  bandwidth  of  the  actuator  which  moves  a 
particular  aerodynamic  surface. 


W.  — -•  . —**•-**••• 
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An  observable  subsystem  is  one  whose  initial  state  x(tQ) 
can  be  completely  and  uniquely  reconstructed  from  all  subsequent 
measurements  y_(t)  and  controls  u(t)  in  the  interval  [t  ,tf]. 
Similarly,  a controllable  subsystem  is  one  which  can  be  brought 
from  an  arbitrary  initial  state  x(tQ)  and  initial  time  to  a 
specified  terminal  state  x(tj-)  within  the  time  span  (t^-to) . 
There  exist  in  the  literature  [6]  certain  mathematical  expres- 
sions which  test  for  observability  and  controllability,  notably 
for  linear  systems.  While  these  expressions  will  not  be  re- 
iterated here,  Figure  8 presents  an  illustration  of  this  most 
basic  concept  of  model  reduction. 


FULL  ORDER  REDUCED  ORDER 


M1  = CONTROLLABLE , UNOBSERVABLE  SUBSYSTEM 

M2  = CONTROLLABLE,  OBSERVABLE  SUBSYSTEM 

M3  = UNCONTROLLABLE,  OBSERVABLE  SUSBSYSTEM 

M1  + M2  + = COMPLETE  SYSTEM  MODEL 

Figure  8.  Reduction  of  Model  Order  by  Elimination  of  Unobservable 
or  Uncontrollable  Subsystems 
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(2)  Singular  Perturbations 


Neglecting  subsystems  and  system  states  which  are 
assumed  to  be  insignificant  to  the  control  objectives  being  ad- 
dressed frequently  takes  on  ad  hoc  connotations,  relying  on  the 
experience  and  engineering  judgment  of  the  designer  to  effect  a 
suitable  reduced- order  model.  A more  systematic  way  of  reducing 
the  order  of  a large  class  of  nonlinear  systems,  namely,  those 
which  exhibit  a wide  dynamic  range  (i.e.  "slow"  and  "fast") 
of  characteristic  modes,  is  provided  by  singular  perturbation 
theory. 

Simp  1 i s t i cal ly , the  singular  perturbation  method  can  be  looked 
upon  as  a time  scaling  procedure,  which  decouples  the  problem  into 
several  problems  of  a lower  order  and  addresses  each  of  these  at 
an  appropriate  time  scale.  The  method  first  defines  the  slowest 
time  scale  (or  "free  - stream"  or  "outer  expansion")  dynamics  by 
assuming  that  all  the  faster  dynamics  are  in  equilibrium.  Once 
this  outer  solution  is  determined,  the  method  then  investigates 
the  faster  time  scale  (or  "boundary  layer"  or  "inner  expansion") 
problem  as  a correction  about  this  outer  solution  [7]. 

The  method  begins  by  grouping  the  states  of  the  high-order 
model  according  to  a small  parameter  e . This  small  parameter 
may  either  occur  naturally  in  the  model  (such  as  a short  time 
constant)  or  it  may  be  introduced  intentionally  as  an  artificial 
time-scaling  parameter.  The  nonlinear  state  model  (Eq.  (1))  is 
then  partitioned  into  the  form: 


— i ■ h 

( 2E-i  * x.2*  -»  O 

( 9) 

£i2  - t2 

(£i,  x2,  u,  t) 

(10) 

where  the  subscripts  1 and  2 refer  to  the  states  associated  with 
the  slower  and  faster  dynamics  respectively.  The  method  then 


seeks  a series  solution  in  e about  e=0;  thus  e is  set  equal 
to  zero  in  Eq.  (10)  which  reduces  to  an  algebraic  relation: 

0 = f_2  Up  x2,  u,  t)  (11) 

This  is  equivalent  to  the  faster  states  x-,  being  in  equilibrium. 
Equation  (11)  serves  as  a condition  which  can  be  used  to  eliminate 
“ertain  of  the  faster  states  x,  or  certain  control  variables* 
u from  Eq.  (9).  For  example,  Eq.  (11)  can  be  solved  for  x ? : 

x2  = £ (x: , u,  t)  (12) 

and  Eq.  (9)  is  reduced  to  the  order  of  the  slower  states  Xp 

il  = I2(Xp  £(x.p  U,  t ) , u,  t)  = fj/tx-p  u,  t)  (15) 

The  solution  of  the  outer  expansion  (Eq.  (13))  neglects  the 
dynamics  of  x,;  the  outer  solution  will  typically  have  discon- 
tinuities (most  noticeably  at  the  initial  time)  because  of  this 
assumption  that  the  states  x->  can  change  their  values  instan- 
taneously. The  boundary  layer  (or  inner  expansion)  analysis  exam- 
ines fast  phenomena  in  terms  of  the  parameter  e and  provides  a 
correction  to  the  outer  solution,  as  illustrated  in  Figure  9. 


* If  the  outer  expansion  is  to  be  solved  by  optimization  methods, 
there  are  cases  where  it  is  mathematically  advantageous  to 
eliminate  some  of  the  elements  of  u and  retain  the  same  number 
of  elements  of  x?  to  act  as  new  control  variables  in  the  outer 

solution.  For  example,  pitch  angle  is  a "fast"  state  in  the 
longitudinal  aircraft  dynamics,  relative  to  flight  path  angle, 
and  elevator  angle  may  be  the  true  control  variable;  the  "outer 
solution”  may  wrell  be  expressed  with  pitch  angle  (the  equilib- 
rated state),  rather  than  elevator,  as  an  effective  control 
variable.  This  procedure  is  particularly  effective  when  the 
elements  of  u being  eliminated  appear  linearly  in  the  differ- 
ential equations  or  cost  functional  (singular  variational 
problems)  or  when  the  elements  of  x,  being  retained  as  new 

“■  L. 

control  variables  are  constrained  independently  of  u (state- 
constrained  variational  problems)  [8]. 
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Figure  9.  Illustration  of  tiic  Singular  Perturbation  Solution 


The  boundary  layer  ( inner  - expans  ion)  is  examined  by  making 
the  time  transformation 

I 

T = t/c  (14) 


In  the  "stretched"  time  scale  x , the  original  Eqs.  (9)  and  (10) 
take  the  form: 


d-l 

ST  = £ -1(-1’  -2’  eT^ 


(15) 


dx 

-37-  = —2  (—1 • —2  * gt) 


(16) 
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Again  letting  e approach  zero,  the  slow  variable  x^(x)  appears 
as  a constant*  in  the  stretched  time,  and  the  behavior  of  the  sys- 
tem in  the  boundary  layer  is  described  by  the  reduced -order  equa- 
tion: 


dx2 

-JT  = -2(-l’  ^ (17) 

where  x^  is  the  average  or  nominal  value  of  as  defined  by 

the  outer  solution. 

In  summary,  Eqs.  (13)  and  (17)  in  the  development  above 
represent  the  two  separate  reduced-order  problems  derived  by  sin- 
gular perturbation  theory  from  the  original  high-dimensional 
problem  (Eqs.  (9)  and  (10)).  In  general,  the  singular  perturbation 
approach  is  approximate  and  the  resulting  design  must  be  checked 
for  validity.  For  the  case  of  linear  systems,  a number  of  mathe- 
matical conditions  and  techniques  have  been  formulated  to  "prove” 
validity  of  the  method  under  restricted  conditions  [7].  The 
singular  perturbation  methods  as  applied  to  aircraft  guidance 
problems  is  discussed  further  in  Section  III. 

(3)  Modal  Decomposition 

For  the  case  of  linear  time- invariant  systems  in 
particular,  a number  of  systematic  methods  have  been  developed 
which  aim  at  decomposing  the  high-order  system  by  identifying 
its  normal  modes  and  then  retaining  only  those  which  are  "dom- 
inant" in  the  system  response,  i.e.,  those  which  are  in  the 
frequency  range  of  interest.  Such  approaches  are  termed  "dom- 
inant mode,"  "dominant  eigenvalue,"  or  "pole  removal"  methods 
[9,  10]. 


i.e.,  Eq . (15)  reduces  to  dx^/dt  = 0. 


* 


Basically,  these  methods  proceed  as  follows.  From  the  pre- 
vious development,  the  linear,  t ime - invar iant  system  model  can  be 
written: 


5 x = A 6 x * 

B 6u 

(18) 

= C 6x  + 

D 6u 

(19) 

This  system  of  equations  can  be  transformed  to  a canonical  (block 
diagonal)  form  by  the  transformation  T,  which  is  an  nxn  matrix 
composed  of  the  column  eigenvectors  of  A: 


<5x  = 

T 

6x  ' 

(20) 

<5x'  = 

A 

6x'  + E 

6u 

(21) 

6v  = 

CT 

6x ' + D 

6u 

(22) 

where 


A is  an  nxn  block  diagonal  matrix 


Sx'  is  an  nxl  vector  of  modal  coordinates 


E is  an  nxm  modal  control  distribution  matrix 

Once  in  this  form,  the  characteristic  modes  of  the  original  system 
can  be  examined  directly  through  the  block  diagonal  elements  of 
A . One  can  now  partition  A such  that,  for  example,  all  "slow" 
or  "dominant"  modes  are  grouped  with  partition  A^  and  all  "fast" 
or  "removable"  modes  are  grouped  with  partition  A7  . The  parti- 
tioned problem  is  then: 


(23) 


(24) 


6Xj 

~Ai 

1 o 

i 

l 

6x{ 

“1 

0 

A 2 

6x^ 

T 

~2 

where  6x^  is  of  dimension  qxl  and  6x,  is  of  dimension  (n-q)xl. 

Now  if  the  "fast"  modes  are  assumed  to  be  in  equilibrium, 
then  the  following  reduction  can  be  made:  the  states  Sx(  are 
assumed  to  be  equilibrated  (i.e.,  6x^  = 0)  and  Eq . (24)  reduces 
to  a q^  order  differential  equation  in  6x^  and  (n-q)  algebraic 
equations  in  <5x^.  Thus,  one  can  write: 

5x,=A<5x,+B  <5u  (25) 

—1  r — 1 r — 


6x2 

6v 

C* 

D* 

= 

C 

6x,  + 

D 

r 

r 

where  the  reduced-model  matrices  are  calculated  as: 


Ar 

* TnAi  Til 

(27) 

B 

r 

= 1 1 ^ A 1^"  1 1^"  1 2A  ~ 2 + ~ 1 ^ 

(28) 

C* 

* T21TU 

(39) 

D* 

= (T21TnTi2  ' T22}A21h2 

(50) 

Cr 

= cx  * c2c* 

(31) 

D = D + C tD*  (32) 

r 2 

Equation  (25)  is  now  the  qth-order  reduced  model;  the 
states  5xt  now  are  observed  merely  as  additional  outputs  of  the 
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system  (Eq.  (26))  rather  than  as  dynamic  entities.  The  poles 
associated  with  A-,  have  essentially  been  "removed"  from  the 
problem  and  only  the  "dominant"  modes  are  retained. 

(4)  Control-Sensitive  Methods 

The  previously  discussed  methods  have  based  their 
order  reduction  decisions  on  the  open- loop  model;  they  ignore  the 
specific  effects  of  the  control  inputs  because  these  inputs  are 
not  known  a priori.  Controllers  designed  based  on  the  open-loop 
methods  (singular  perturbations,  dominant  eigenvalues,  etc.)  be- 
have as  predicted  if  the  control  bandwidth  is  sufficiently  low 
as  to  not  alter  the  original  "slow"  and  "fast"  designation  of  the 
modes.  However,  if  the  control  objectives  require  a high  band- 
width, those  modes  originally  designated  as  slow  may  become  fast 
in  closed-loop  operation,  and  performance  may  deteriorate  from 
that  predicted. 

Considerable  recent  effort  [11,  12]  has  been  directed  towards 
developing  model  reduction  methods  which  are  "sensitive"  to  the 
control  objectives.  These  methods,  then,  proceed  to  derive  the 
reduced-order  model  such  that  the  optimal  control  policy  for  the 
reduced  - order  model  is  the  "best"  subopt imal  control  policy  for 
the  actual  system.  The  model  reduction  and  control  design  pro- 
cedures are  thus  intertwined. 

While  these  control  - sens itive  methods  avoid  the  above- 
mentioned  problems  with  open-loop  model  reduction,  they  do  incur 
added  off- line  computational  burden  over  the  more  standard  tech- 
niques. The  implementational  form  of  the  resultant  controller, 
however,  compares  favorably  with  the  standard  techniques.  Further 
discussion  on  these  advanced  methods  is  beyond  the  scope  of  this 
report . 
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Aircraft  State  Models 


e . 


Models  which  have  been  developed  and  refined  (for  ex- 
ample by  using  the  model  reduction  techniques  described  above) 
for  application  to  the  design  of  aircraft  control  systems  vary 
widely,  ranging  from  simple  point-mass  "quas i - steady"*  repres- 
entations to  sophisticated  high-order  models  which  include  de- 
flections of  the  airframe.  For  control  design  purposes,  the 
designer  typically  attempts  to  arrive  at  the  simplest  model  which 
adequately  represents  the  "control  object"  or  "plant”  being  ad- 
dressed. This  will  usually  result  in  the  least  expensive  design 
in  terms  of  engineering  effort  and  also  of  implementation  costs. 
Moreover,  simpler  models  frequently  allow  the  designer  to  acquire 
more  insight  into  the  process  being  controlled,  resulting  from 
the  paring  away  of  variable  and  functional  relationships  which 
are  of  secondary  importance  to  the  achievement  of  the  control 
objectives.  However,  it  is  good  engineering  practice  to  retain 
higher  fidelity  system  models  as  well,  and  use  these  to  check  the 
design  which  was  based  on  the  simpler,  more  extensively  approx- 
imated models. 

While  an  extensive  summary  of  aircraft  modeling  activities 
is  beyond  the  scope  of  this  report,  a discussion  of  selected  mod- 
eling techniques  and  approximations  is  presented  in  the  Appendix, 
which  comments  specifically  on  six-degree-of-freedom  aerodynamic 
modeling  (see  also  Ref.  4);  the  quasi-steady  approximation;  and  the 
energy-state  approximation. 


* The  quasi-steady  approximation  neglects  acceleration  of  the 
aircraft . 
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3. 


DESIGN  APPROACHES 


Many  techniques  have  been  developed  to  synthesize  control 
systems  in  general  and  aircraft  guidance  and  control  systems  in 
particular.  These  techniques  are  typically  categorized  as  to 
whether  they  treat  linear  or  nonlinear  systems,  time-varying  or 
time- invariant  systems,  continuous  or  discrete  systems,  multi- 
variable  or  single- input/single-output  systems,  etc.  Addition- 
ally, techniques  can  be  compared  as  to  the  performance  criterion 
they  are  attempting  to  satisfy  and  the  general  structure  of  the 
resulting  controller  design. 

The  individual  techniques  can  be  organized  into  several  gen- 
eral approaches,  the  following  three  of  which  will  be  discussed 
in  the  remainder  of  this  section: 

• Nonlinear  Optimal  Control 

• Linear  Optimal  Control  (Quadratic  Synthesis) 

• Classical  Control 

Perhaps  the  key  distinction  between  overall  approaches  to 
aircraft  guidance  and  control  system  design  is  whether  the  design 
approach  requires  a linear,  time  invariant  system  model.  This  is 
the  case  with  the  bulk  of  the  classical  techniques  and  with  some 
of  the  model  reduction  procedures  (modal  decomposition)  discussed 
above . 

Fortunately,  for  many  problems  of  interest  in  aircraft 
guidance  and  control,  a quasi-static  approximation  can  be  made. 
This  proceeds  as  follows.  The  time-varying  state  model  after 
linearization  is  given  by  Eqs.  (7,  8),  which  are  repeated  below: 

6x(t)  = A ( t ) 6x(t)  + B ( t ) <$u(t)  (33) 

fi£(t)  = C(t)  5x(t)  + D ( t ) 6u(t)  (34) 
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Often,  the  variations  in  the  matrix  elements  are  slow  relative  to 
the  dynamics  of  the  state  variables  themselves.  In  this  case,  a 
common  engineering  practice  is  to  approximate  the  time-varying 
linear  system  by  a series  of  time  - invariant  system  models,  each 
referred  to  a particular  reference  point  or  "flight  condition." 
Separate  designs  are  then  based  on  each  of  the  linear,  time- 
invariant  models,  and  the  individual  designs  then  aggregated  in 
such  a way  as  to  cover  the  flight  envelope,  i.e.,  the  full  range 
of  flight  conditions  addressed  by  the  design.  Typically,  a suf- 
ficiently general  controller  structure  is  selected  so  that  only 
the  controller's  parameters  or  gains  need  be  "scheduled"  or  varied 
as  a function  of  trajectory  variables  (e.g.,  dynamic  pressure, 

Mach  number,  etc.)  in  order  to  effect  the  required  aggregated 
design.  Optimal  control  techniques,  both  linear  and  nonlinear, 
are  not  restricted  to  t ime- i nvariant  systems,  and  consequently  do 
not  rely  on  the  quasi-static  assumption.  This  distinction  will 
be  evident  in  the  remainder  of  this  section. 

a.  Nonlinear  Optimal  Control 

Presented  here  is  a brief  summary  of  the  optimal  control 
design  approach.  The  summary  addresses  deterministic  optimal  con- 
trol only,  rather  than  stochastic  control  where  random  inputs  and 
uncertainties  in  the  system  parameters  are  allowed.  Emphasis  is 
on  the  basic  principles  and  motivations  of  the  approach  as  applied 
to  the  aircraft  guidance  and  control  problem.  Rigorous  develop- 
ment is  beyond  the  scope  of  this  report;  for  a more  detailed 
treatment  of  the  subject,  the  reader  is  referred  to  Refs.  6,  13 
and  14. 

(1)  System  Model 

The  nonlinear  system  model  addressed  by  the  optimal 
control  approach  was  developed  above  and  can  be  expressed  in  the 
form : 


x(t)  = f (x(t)  , u (. t ) , t) 


(.35) 


with  the  initial  condition  x(tQ)  given.  As  will  be  seen  later,  in 
the  solution  to  the  optimal  control  problem,  this  state  dynamic 
relation  is  treated  as  a "constraint"  which  must  be  satisfied  at 
every  point  along  the  solution  trajectory. 

(2)  Performance  Index 

The  crux  of  the  optimal  control  design  approach  is 
the  specification  of  an  appropriate  performance  index  (.or  cost 
func t ional 1 because  the  "optimality"  of  the  resulting  design  only 
has  meaning  when  referred  to  this  performance  criterion.  The 
performance  index  must  be  posed  in  a suitably  concise  form  so 
as  to  be  economically  solvable  by  mathematical  techniques,  yet 
it  must  be  sufficiently  general  to  encompass  a number  and  div- 
ersity of  design  objectives.  Such  objectives  might  address  the 
time,  fuel,  or  energy  to  reach  a target  condition,  the  terminal 
errors,  mean-squared  error  along  a path,  etc. 

The  form  for  the  performance  index  which  has  evolved  to 
meet  these  broad  and  often  conflicting  requirements  is  given  by: 

J - 4>(x(t0),  x(tf)  ,t  ,tf)  + J L (x  (t ) , u(t)  ,t)  dt  (56) 

t 

o 

The  performance  index,  J,  is  a scalar  function  which  is  defined 
such  that  low  values  of  J (the  "cost")  indicate  "good"  perform- 
ance and  high  values  of  J indicate  "bad"  performance.  As  can 
be  seen  in  the  above  expression,  J incorporates  any  requirements 
on  the  initial  or  terminal  state  by  means  of  the  penalty  function 
0 (x  ( tQ)  , x ( t £•)  , tQ  , t £•)  and  any  state- variable  constraints,  control- 
variable  constraints,  and  optimality  criteria  in  the  function 
L(x  (t) ,u(t) , t)  , which  accrues  penalty  over  the  entire  time  in- 
terval of  interest  [t,t£] . 

Table  1 illustrates  the  generality  of  the  performance  index 
form  (Eq.  (3b))  for  expressing  the  control  objectives  of  several 
simple  aircraft  guidance  and  control  problems.  Other  such  examples 
are  provided  in  Section  III. 
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TABLE  1 

EXAMPLES  OE  THE  GENERALITY  OF  THE  PERFORMANCE 
INDEX  STRUCTURAL  FORM 


PROBLEM 


Minimum  Time 


If 


J = $(x( t0),x(tf),tQ,tf)  + f L(x(t),u(t),t)dt 


J = t--t„  = / 
r o 


tf 


dt 


I Minimum  "weight- 
i ed"  (by  H)  ter- 
' mi nal  errors 


J = 


Minimum  "weight- 
ed" (by  R)  con- 
trol effort 


Optimal  track- 
ing of  refer- 
ence r,  weight- 
ed by  Q 


x(tf)-r(tf)]  H 
[x(tf)-r(tf )] 


f 

J = C u'(t)Ru(t)dt 


if  X 

J - J [x(t)-r(t)]  Q 

Jt0 

[x(t)-r(t)]dt 


<Mx(tf)) 


EXAMPLES 


• Intercept  of  at- 
tacking aircraft 
and  mi ssi les 

• Slewing-mode  opera- 
tion of  radar  or 
gun  system 


• Ball istic  missile 
control 

• Rendezvous  for 
cargo  delivery 


L|u(t)) 


L | x ( t ) ) 


• Minimum  rate  of 
fuel  consumption 
for  rocket  engine 


• Slewing  of  radar  or 
gun  to  track  target  j 

• Maintaining  aircraftj 
near  reference  path  j 


(3)  End  Conditions 


To  complete  the  formulation  of  the  optimal  control 
problem,  one  must  consider  the  end  conditions  required  to  be  met 
by  the  problem  solution.  In  general,  the  initial  and  final  states 
(end  states')  and  the  initial  and  final  times  (end  times)  can  be 
defined  by  a vector  of  algebraic  expressions: 

£(x(tQ) ,x(tf) ,tQ,tf)  = o (37) 

Any  of  these  end  states  and  end  times  may  be  completely  fixed, 
completely  free  (i.e.,  unconstrained),  or  related  to  other  end 
conditions*  (i.e.,  certain  relationships  between  the  states  and 
times  must  be  satisfied  at  the  end  conditions). 

(4)  Problem  Formulation  Summary 

The  optimal  control  problem  may  now  be  stated 
s imp  1 is t ical ly : Find  the  control  u(t)  which  minimizes  the  per- 
formance index  J (Eq.  (36))  and  conforms  to  prescribed  terminal 
constraints  £ (Hq.  (37))  while  satisfying  the  system  dynamical 
equations  (Eq.  (35) ) . 

Before  the  problem  formulation  is  complete,  one  must  consider 
the  assumptions  which  may  be  permitted  in  order  to  arrive  at  its 
solution.  Typically,  these  assumptions  relate  to  the  differentia- 
bility of  the  functions  <t> , L,  f,  and  ^ and  to  the  boundedness 
of  the  states  x and  controls  u.  For  the  remainder  of  this 
discussion,  it  will  be  taken  that  all  necessary  assumptions  for 
solution  are  met  and  that  the  states  are  unbounded  but  the  con- 
trols are  bounded . The  allowance  for  bounded  rather  than  un- 
bounded controls  is  of  importance,  since  most  physical  processes 
contain  controls  that  are  bounded.  Some  aerospace  vehicle  examples 


* Another  way  of  saying  this  is  that  the  end  conditions  are 
located  on  a hypersurface  or  manifold. 


are:  minimum  and  maximum  thrust  of  a propulsion  system,  minimum 

and  maximum  deflection  of  a thrust  vector,  maximum  available  con- 
trol power,  maximum  thrust  vector  rotation  rate,  etc. 

(5)  Solution  Techniques 

Most  cf  the  multitude  of  solution  techniques  which 
have  been  developed  to  address  the  optimal  control  problem  can  be 
placed  in  the  following  two  categories: 

• Calculus  of  variations  techniques 

• Numerical  techniques 

Calculus  of  variations  (notably  the  Pontryagin  minimum  principle 
[15])  techniques  can  be  used  to  obtain  a set  of  ana  1 y t ic  expres- 
sions which  constitute  a set  of  necessary  conditions  for  optimal- 
ity. Numerical  techniques  are  inherently  iterat  ive , but  can  be 
used  to  converge  on  the  optimal  control  time  function  and  associ- 
ated optimal  trajectory  ever  the  time  interval  [tQ,t^j. 

There  are  many  and  varied  numerical  iterative  techniques 
(e.g.,  the  gradient  method  and  quasi- 1 inear izat ion  method,  Ref.  14, 
Chapter  7;  differential  dynamic  programming.  Ref.  lb;  among  others) 
further  treatment  of  these  is  beyond  the  scope  of  this  report. 

Because  of  its  widespread  use  and  the  insight  it  lends  into  the 
nature  of  solution  of  the  optimal  control  problem,  however,  the 
"minimum  principle"  approach  will  be  summarized  below. 

(6)  Minimum  Principle 

Solution  by  the  minimum  principle  involves  first 
augmenting  the  performance  index  by  the  mathematical  technique 
of  adjoining  the  constraints  (Eqs.  (35)  and  (37))  to  the  perform- 
ance index  J.  This  effectively  converts  the  original  constrained 
problerr  to  an  unconstr  a ined  problem  of  higher  dimension.  The 
"increase  in  dimension"  is  due  to  the  use  of  Lagrange  multiplier 
(adjoint)  vectors  v and  X^(t)  . The  adjoined  performance 
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J* 


index  is: 


» 

II 

T 

+ V 

/f 

<P  + 

T 

A C£-x) 

~ J 

*o 

which,  using  Eq. 

(56) 

, can  be 

written : 

J*  = 4) 

T 

+ V 

♦ + / 

T 

(L  ♦ 

- J 

to 

(58) 


(39) 


The  adjoined  performance  index  may  finally  be  written  in  the  more 
concise  form: 


J*  = $ + 


c 

f 


f T . 

(H  - X1  x)  dt 


(40) 


by  defining  the  Mayer  funct iona 1 : 

4>  lx(t0)  ,x(tf)  .tQ.tf  ) - (x(tQ)  ,x(tf)  ,t0,tf ) 


+ V £1  x(tQ)  ,x(tf)  , t0,tf 


(41) 


and  the  Hamiltonian: 


H(x(t)  ,u(t)  ,_X(t)  ,t)  = L ( x (t ) , u ( t ) , t ) 

♦ IT  Hi(t)  ,u(t)  ,t)  (42) 

The  minimum  principle  now  determines  the  control  which  mini- 
mises J*  of  Eq . (40)  by  examining  the  variation  in  J*  (i.e.,  6J* 
due  to  variations  in  the  control  (5u) . An  extremum  (i.e.,  a 
minimum  under  the  desired  circumstances)  is  reached  where  6J*  = 0 


for  arbitrary  6u.  This  requirement  leads  directly  (Ref.  14 
Chapter  2)  to  the  Kuler- Lagrange  equations: 


3H 

3.x 


(43) 


3H 

3u 


0 


i 44) 


Equation  (4  3)  is  also  called  the  "adj  oint"  or  "co-state"  equa - 
tion,  since  it  describes  the  dynamics  of  the  adj  oint  (or  co- s tate ) 
vector  A(t) . The  optimal  control  (t)  is  found  from  Eq . (44) 

if  the  control  set  is  unbounded  (unconstrained).  For  a restricted 
control  set,  alternate  procedures  must  be  used  to  find  the  control 
which  minimizes  the  Hamiltonian*  (Ref.  17,  Section  4.5). 


The  minimum  principle  also  determines  expressions  for  boundary 
or  transversal ity  conditions  necessary  in  the  total  solution. 

These  expressions  vary  as  a function  of  the  "freedom"  in  the  end 
conditions  for  x and  t,  as  specified  in  the  problem  formulation. 

For  example,  if  there  are  no  terminal  constraints  ( vyC  t ^ ) = 0)  and 
the  terminal  time  is  a fixed  rather  than  free  value,  the  trans- 
versality  condition  is: 


T 


A summary  of  some  of  the  more  common  end  conditions  and  the  corres- 
ponding t ransver sa 1 i tv  conditions  are  illustrated  in  Table  2. 


(7)  Comments 

The  minimum  principle  approach,  while  it  yields 
valuable  insight  into  the  optimal  control  problem  by  providing 
analytical  expressions  for  optimality,  is  not  without  practical 
difficulties.  Many  of  these  difficulties  stem  from  the  usual 

* i.e.,  Eq . (44)  will  yield  an  expression  for  the  control  which 

minimizes  the  Hamiltonian  if  the  control  set  is  unbounded. 
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TABLE  2 

ILLUSTRATION  OF  TYPICAL  END  CONDITIONS  AND 
ASSOCIATED  TRANSVERSAL  I TY  EXPRESSIONS 


DESCRIPTION 


ixed 

fixed 

rid 

ondi tions 

eixed  x ( t ' 

i 

- 0 

pUed  x(tf) 

fined  t 

>ee 

emnnal 

Fined  tf 

cate 

Fined  nt  t 

- 3 

F re*  x( t.) 

're* 
Tem»1n«  l 
Time 


re*ielnal  Time 
.Inspect  *’*3 
3ut  ^elated 
to  Terminal 

State 


free  t, 

fixed  x(t  ) 
— o 


cixed  x(t  ) 


IlLJSTRATION  of 

TRANSVERSAlITY 

ACCEPTABLE  TRAJECTORIES 

occurrence  of  "split”  boundary  conditions  of  the  differential 
equations  which  must  be  solved  to  obtain  the  optimal  control.  This 
two-point  boundary- value  problem  is  illustrated  by  summarizing  the 
above  development  as  follows:  To  find  the  optimal  control,  one  must 
solve  the  following  differential  equations: 


(46) 


Equations  (49)  and  (50)  constitute  the  split  boundary  conditions. 

In  general,  numerical  methods  or  approximate  analytical  methods 
must  be  used  to  solve  such  a problem,  namely,  to  integrate  Eqs . 

(46)  and  (47)  subject  to  the  boundary  conditions  (49)  and  (50). 

The  solution  to  the  nonlinear  optimal  control  problem  (found 
either  analytically  or  numerically)  is  usually  expressed  simply  as 
a function  of  time.  Thus  it  can  be  pre-computed  off-line,  stored, 
and  retrieved  on-line  and  applied  as  necessary.  Consequently,  the 
optimal  control  (t)  is  an  "open- loop"  control.  It  is  based 

entirely  on  the  a priori  model  of  the  system  (Eq.  (46));  the 
optimal  control  does  not  require  (or,  more  to  the  point,  admit ) 
measurements  of  the  state  at  any  time  other  than  the  initial  con- 
dition x(tQ).  As  a result,  the  optimal  control  is  not  sensitive 
to  deviations  of  the  actual  state  from  that  predicted  by  the  model, 
which  may  contain  errors  or  approximations.  Moreover,  the  optimal 
control  is  not  sensitive  to  unmodeled  disturbances  which  may 
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further  drive  the  system  states  away  from  their  modeled  behavior. 
This  open-loop  nature  of  the  optimal  control  is  illustrated  in 
Figure  10. 

One  way  of  dealing  with  these  problems  is  to  close  the  loop 
in  effect  by  re-computing  the  optimal  control  periodically,  using 
the  current  best  estimate  of  the  state  (.derived  from  the  feedback 
sensors)  as  the  initial  condition  for  the  most  recent  solution. 

This  technique,  while  providing  a closed-loop  feedback  control, 
can  be  extremely  resource  consuming,  depending  on  the  complexity 
of  the  control  calculation  and  the  repetition  frequency  required 
to  satisfy  closed-loop  control  objectives. 

Under  certain  circumstances,  it  is  possible  to  derive  a closed- 
loop  feedback  form  for  the  optimal  control  law  directly,  i.e.,  the 
control  u can  be  expressed  as  a function  of  the  state  x: 

u = u(x)  (51) 

In  this  way,  the  current  best  estimate  of  the  state  can  be  used  to 
calculate  the  current  best  value  of  control  to  be  applied,  as 
illustrated  in  Figure  11.  The  motivations  for  this  state  feedback 
control  law  and  some  conditions  under  which  it  can  be  obtained  are 
discussed  in  the  next  section. 

b.  Linear  Optimal  Control 

A large  and  important  class  of  problems  for  which  an  opti- 
mal feedback  control  law,  u = u(.x)  , can  be  found  directly  is  that 
characterized  by  a linear  system  model  and  a performance  index  whose 
elements  are  quadratic  forms.  Under  these  conditions,  a 1 inear 
feedback  control  law  can  be  found;  i.e.,  the  variational  control 
5u  is  a linear  function  of  the  variational  state  6x: 


5u(t)  = - K ( t ) 6x ( t ) 


f 52) 


where  the  linear  gain  matrix  K(t)  can  be  pre-computed  and  stored. 
The  on-line,  instantaneous  control  is  calculated  by  retrieving  the 
current  value  of  K(t)  from  memory  and  merely  multiplying  by  the 
current  best  estimate  of  the  state  x.  The  method  of  deriving  this 
optimal  linear  feedback  control  law  is  called  "linear-quadratic" 
design  or  "quadratic  synthesis." 
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Figure  11.  Optimal  Closed-Loop  Control  - u Is  Calculated 
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(1)  Quadratic  Performance  Index 


The  performance  index  to  be  minimized  in  order  to 
derive  the  optimal  linear  feedback  control  law  (Eq.  (52))  is  given 
by  the  following  functional  form: 

tf 

J = 7<5xT(tf)  Sf  6x(tf)  ♦ | J (6xT(t)  Q(t)  6x(t) 

♦ 6 uT  ( t ) R(t)  <5u(t)  jdt  (53) 

where 


S,  is  an  nxn  weighting  matrix  on  the  terminal  state 
error 

Q(t)  is  an  nxn  weighting  matrix  on  the  along-path  state 
error 

R(t)  is  an  mxm  weighting  matrix  on  the  control  deviation 
from  nominal 

S and  Q must  be  at  least  positive  semi -definite  and  R must  be  posi- 
tive definite  in  order  to  obtain  the  desired  form  of  the  control 
law.  Q and  R can  be  functions  of  time;  all  matrices,  if  they 
depend  explicitly  on  system  states  x(t)  or  controls  u(t),  are 
evaluated  at  the  reference  values  xQ(t)  an^  u (t). 

There  are  two  compelling  reasons  for  choosing  the  quadratic 
form  for  the  performance  index.  One  of  these,  as  will  be  seen 
shortly,  is  that  the  mathematics  of  solving  the  split  boundary 
condition  problem  is  greatly  simplified.  A more  satisfying 
reason,  however,  derives  from  the  model  linearization  process  as 
presented  previously.  As  shown  in  Eqs . (5)  and  (6)  and  repeated 


below,  the  linearization  process  entails  expanding  the  nonlinear 
model  in  Taylor  Series  about  the  reference  values  x and  u : 


3f 


f(x(.t),  u(t))  = l(xo(t),  u0(t))  + 3^ 


6x  (t) 


3_f 

3u 


6u(t)  + a (5x(t),  6u(t))  (54) 


3g 


6x(t) 


&(iCt),  u(t))  = i(xo(t),  u0(t)j  + 

o 

5u(t)  + <Su(t)) 


3c 


3u 


(55) 


The  linear  model  retains  the  linear  terms  and  neglects  the  higher- 

order  terms  a and  6 in  the  expansion. 

—o—o  v 

If  these  higher  order  terms  are  not  forced  to  remain  small, 
however,  the  validity  of  the  first-order  linear  model  can  be 
jeopardized.  Fortunately,  it  can  be  shown  [5]  that  minimizing  the 
quadratic  performance  index  is  equivalent  to  minimizing  the  magni- 
tude (norm)  of  the  higher  order  terms  integrated  over  the  time 
period  of  interest.  Thus,  the  perturbation  control  5u  based  on  the 
the  quadratic  performance  index  is  the  control  which  ensures  the 
best  linear  model  of  the  system  being  addressed.  This  is  desirable 
because  the  derivation  of  the  optimal  perturbation  control  is  based 
on  the  linear  model  itself. 
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(Z)  Linear-Quadratic  Problem  and  Its  Solution 


In  summary,  the  linear-quadratic  problem  is  to  find 
the  perturbation  control  6u  which  minimizes  the  performance 
index  given  by  Eq.  (.53)  for  the  linear,  time-varying  system 

6x(.t)  = A(t)6x(t)  + B(t)Su(t)  (56) 

The  initial  condition  x(tQ)  is  given,  the  final  time  is  fixed  at 
the  value  tp  and  both  the  perturbation  states  and  perturbation 
controls  are  unconstrained. 

Solution  of  the  linear-quadratic  problem  by  the  backward  sweep 
method  is  well  known  (Ref.  14,  Chapter  5;  Ref.  17,  Section  5.1). 

The  solution  is : 

Su(t)  = - K (t ) 6x(t)  (57) 

where  the  mxn  feedback  gain  matrix  is  given  by: 

K(t)  = R_1 (t)B1 (t)S(t)  (58) 

and  S(t)  is  the  Riccati  matrix,  which  is  found  by  solution  of  the 
Riccati  differential  equation: 

S(t)  = - S(t)  A (t)  - AT(t)  S(t)  - Q ( t ) 

+ S(t)  B ( t ) R" 1 ( t ) BT  ( t ) S(t)  (59) 


The  Riccati  equation  is  integrated  backwards  in  time  from  the 
terminal  boundary  condition: 

S(tf)  = Sf  (60) 

Implementation  of  this  solution  (Eqs.  (57)  through  (60)) 
can  be  quite  simple  in  terms  of  on-line  computational  requirements. 
Often,  only  Eq.  (57)  need  be  computed  on-line.  This  is  the  case 
when  the  references  x ft)  and  u ft)  are  known  for  all  time  in  the 


interval  of  interest  (see  Figure  12).  It  is  also  the  case  when 
none  of  the  matrices  involved  in  the  solution  (namely,  A,  B,  Q, 

R and  Sf)  depend  explicitly  on  the  reference  trajectory  and  control. 


Figure  12.  Illustration  of  Minimal  On-Line  Computational  Require- 
ments When  Reference  State  and  Reference  Control  Can 
Be  Pre-Calculated 


This  will  not  always  be  the  case,  however,  and  the  designer  is  left 
with  two  main  choices: 

1)  Re-solve  on-line  for  the  gain  matrix  (Eqs.  (58)  and 
(59))  periodically  as  reference  variables  change;  or 

(2)  Solve  the  problem  off-line  for  a number  of  reference 

conditions  and  store  K in  a "schedule"  as  a function  of 
these  reference  conditions;  on-line  computation  then 
involves  looking-up  the  proper  gain  from  a table*  (per- 
haps a multi-dimensional  table)  and  making  the  multipli- 
cation of  Eq . (57)  . 


* This  latter  approach  is  similar  to  the  quasi-static  gain- 
scheduling technique  used  frequently  in  classical  designs. 


Various  trade-off  studies  can  be  performed  to  determine  which  of 
these  choices  results  in  the  most  favorable  combination  of  perfor- 
mance and  computational  load. 

(3)  Quadratic  Synthesis 

Quadratic  synthesis  refers  to  the  process  of  formulat- 
ing, solving,  and  implementing  the  linear-quadratic  design.  Act- 
ivities which  the  engineer  may  have  to  perform  in  this  overall  de- 
sign are  listed  in  Figure  13.  Also  shown  in  the  figure  are  various 
iterations  which  may  occur  in  the  design  process  to  arrive  at  the 
proper  final  compromise  between  performance  capability  and  imple- 
mentational  cost,  in  terms  of  engineering  effort  and  computational 
hardware  and  software  requirements. 

The  main  thrust  of  quadratic  synthesis,  however,  is  the  selec- 
tion and  refinement  of  the  weighting  matrices  S^-,  Q(t),  and  R(t)  in 
the  performance  index.  The  selection  of  these  matrices  determines 
the  character  of  the  closed  loop  control,  much  as  frequency  response 
shaping  can  determine  the  character  of  a classical  design.  Simi- 
larly, the  refinement  of  the  weighting  matrices  is  an  iterative 
process,  requiring  a certain  amount  of  experience  and  engineering 
judgment.  However,  the  weighting  matrices  provide  a great  deal  of 
insight  into  the  design  of  complex,  coupled,  multivariable  systems. 
As  a result  of  this  insight,  many  "rules  of  thumb"  [5]  have  evolved 
for  the  design  of  large  classes  of  aerospace  systems.  A few  of 
These  are  summarized  below: 

1)  Often  a good  choice  (at  least  initially)  of  the  weight- 
ing matrices  is  a diagonal  form  where  the  elements  along 
the  diagonal  are  inversely  proportional  to  the  square 
of  the  maximum  desirable  value  of  the  quantity  in 
question;  or,  mathematically,  if  q...  r • and  s-. 
the  el ement s o f Q , R and  S £ : -*  1 -1  ^ 

q . . = 1 / ( x ( t ) ] “ ifi=j;  0 i f i f j 
' ij  1 max  1 1 l J ’ J 


are 

(61) 
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PROBLEM  FORMULATION 
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• Derive  non-linear  system  model  (Eq.  (46) 

• Determine  reference  trajectory  and  control 

— — • Derive  linearized  system  model  (Eq.  (56)) 

=C  # Select  weighting  matrices  for  performance  index  (Eq.  (53)) 

PROBLEM  SOLUTION 

• Solve  matrix  Riccati  Equation  (59)  to  obtain  feedback  gain 
matrix  K(t)  (this  may  involve  numerical  integration) 

— t Evaluate  performance  of  optimal  gain  (either  analytically  or 
in  simulation) 

DESIGN  IMPLEMENTATION 

— — • Analyze  trade-offs  between  performance  and  various  design 
approximations  used  to  reduce  implementation  costs 

EE  • Evaluate  implemented  design  in  simulation 

t Install  final  design  and  perform  checkout  and  operational 
testing 


Figure  13. 


Typical  Design  Activities 
and  Implementation  of  the 


in  the  Formulation,  Solution, 
Linear-Quadratic  Design 
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Another  candidate  initial  choice,  one  which  relates 
approximately  to  minimizing  the  second  variation  in  J, 
is  : 


Q ( t ) 


3-H 

3xtt)2 


o 


f 54) 


R ( t ) 


Sf 


2 

3 H 


3“(t)‘'|o 

3“4> 

3x(tf)  2 


165) 


( 66 ) 


where  $ is  the  Mayer  functional  (Eq.  (41))  and  II  is  the 
Hamiltonian  (Eq.  (42))  and  the  subscript  (o)  refers 
to  the  reference  trajectory. 

2)  The  larger  the  norm  of  the  matrix  S^-  (i.e.,  |ISr!|),  the 

larger  the  gain  matrix  K(t)  at  times  near  the  final  time. 
Thus,  as  the  final  time  approaches,  certain  elements  of 
the  control  vector  may  get  (unacceptably)  large.  One 
way  of  dealing  with  this  problem  is  to  gradually  bring 
1 I Q ( t ) i i , which  penalizes  state  deviations  along  the 
path,  to  a magnitude  comparable  with  S ^ when  nearing  t ^ . 

5)  The  larger  |Q(t) | i , the  larger  the  gain  matrix  K and 

the  shorter  the  time  period  in  which  state  perturbations 
are  reduced  to  small  values.  In  effect,  increasing 
[ J Q ( t ) | - increases  the  bandwidth  of  the  closed-loop 
system. 

1)  The  larger  ||R(t)|i,  the  smaller  the  gain  matrix  K and 
the  slower  the  system  response. 

5)  Frequently,  the  perturbation  state  vector  contains 

variables  3nd  also  their  time  derivatives  (e.g.,  pitch 
angle  and  pitch  rate).  In  such  a case,  penalizing  by 
Q the  pitch  angle  only  and  not  its  rate  of  change  will 
lead  to  a more  oscillatory  response.  Penalizing  the 
pitch  rate  also  will  reduce  overshoots  and  lead  to  a 
less  oscillatory  response.  This  is  akin  to  increasing 
the  damping  coefficient  of  a second-order  svstem. 
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Comparison  to  Classical  Methods 


c . 


As  mentioned  previously,  classical  methods  normally 
address  only  a subset  of  the  systems  previously  considered,  namely, 
the  subset  known  as  linear,  time- invar iant  systems.  Such  systems 
are  characterised  by  constant -coefficient  differential  equations. 
This  permits  the  formation  of  output/input  transfer  functions  and 
the  transform  analysis  of  such  relations  by  frequency  domain  meth- 
ods (Bode  Diagrams,  Nichols'  Charts,  etc.).  When  applicable,  such 
methods  yield  valuable  information  about  the  character  of  the  sys- 
tem, which  can  be  used  to  evaluate  and  improve  control  system 
designs.  Even  if  a linear,  t ime- invar iant , quadratic  synthesis 
method  is  applied  to  the  design  of  particular  control  system,  it 
is  good  engineering  practice  to  check  and  analyze  the  resulting 
design  using  classical  methods  wherever  possible. 

The  remainder  of  this  section  compares  various  aspects  of 
the  classical  design  methods  with  corresponding  elements  of  the 
optimal  control  approach. 

(1)  Comparison  of  System  Structure 

Optimal  control  theory  distinguishes  between  the  con- 
trol u,  state  x,  and  measurement  v of  a linear  system.  Again 
the  system  parameters  may  be  time  varying.  Classical  control  theor 
distinguishes  only  between  the  control  (input)  u and  the  measure 
ment  (output)  v of  the  linear  system.  The  system  parameters  are 
constant.  An  illustration  of  the  two  basic  system  structures  is 
provided  in  Figure  14. 

(2)  Comparison  of  Design  Criteria 

Optimal  control  theory  minimizes  an  index  of  system 
performance  in  the  time  domain.  The  index  contains  both  constant 
and  time-varying  weighting  matrices  that,  to  a large  extent,  can  be 
chosen  freely.  The  elements  of  these  matrices  have  a rather  direct 
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Figure  14.  Comparison  of  the  Basic  System  Structures  of 

Classical  and  Optimal  Control  Theory  (Example: 
Single- Input/Single- Output) 


physical  interpretation.  The  final  time  of  the  (transient) 
response  may  be  prescribed  arbitrarily,  and  requirements  on  the 
final  state  can  be  incorporated. 

Classical  control  theory  defines  the  "desired,"  fixed, 
closed-loop  pole  locations,  associated  with  "desirable"  system 
response.  However,  the  relation  between  closed-loop  pole  loca- 
tions and  sys tern, respons e becomes  more  obscure  as  the  system 
becomes  more  complex  (mul ti - input /mult i - output ) . Also,  the  rela- 
tion between  closed-loop  pole  locations  and  system  response  is  not 
unique:  the  location  of  the  closed-loop  zeroes  is  also  of  impor- 

tance. Final  time  of  the  response  is  fixed  at  infinity,  since  the 
main  interest  is  really  in  steady  state  behavior  [13]. 

(3)  Comparison  of  the  Control  Law 


Optimal  control  theory,  as  applied  to  the  quadratic 
performance  index,  leads  directly  to  a linear  feedback  law  with 
time-varying  gains.  In  general,  all  elements  of  the  (n-dimensional) 
state  vector  are  to  be  fed  back  to  all  controls.  The  time-varying 


gains  lead  to  t ime- vary ing  locations  of  the  closed-loop  poles  and 
leroes . 

Classical  control  theory  assumes  control  to  be  of  the  linear, 
output  - feedback  type,  i.e.,  the  elements  of  the  (m- dimens ional ) 
measurement  vector  are  to  be  fed  back.  The  gains  are  assumed  to 
be  constant.  They  are  chosen  such  that  the  "desirable"  closed-loop 
pole  locations  are  obtained.  If  this  objective  cannot  be  met,  then 
"compensation  techniques"  (cascade  compensation;  feedback  compensa- 
tion) are  used  to  help  achieve  it. 

The  classical  approach's  use  of  the  m-dimens ional  (external) 
measurement  vector  for  feedback  instead  of  the  n - d imens iona  1 
(internal)  state  vector  leads,  in  general,  to  less  satisfactory 
response,  since  the  measurement  vector  contains  less  information 
about  the  system  than  does  the  full  state  estimate.  However,  a 
significant  computer  resource  is  required  to  "estimate"  the  full 
system  state  from  a reduced  number  of  noisy  measurements.  For- 
tunately, modern  airborne  computing  systems  are  well  capable  of 
this  state  re-construction  (by  Kalman  filter's,  for  example);  this 
fact  helps  make  the  full  state  feedback  design  viable. 


48 


SECTION  III 

PATH  CONTROL  SYSTEM  DESIGN 


1.  INTRODUCTION 


A number  of  aircraft  guidance  and  control  problems  have  been 
addressed  by  the  design  approaches  summarized  in  Section  II. 
Typically,  the  overall  aircraft  guidance  and  control  task  is 
broken  down  into  a number  of  subproblems  (.navigation,  horizontal 
guidance,  stability  augmentation,  etc.)  and  each  of  these  ad- 
dressed by  design  techniques  which  are  best  suited  to  the  charac- 
teristics and  design  objectives  of  the  particular  subproblem. 

The  diverse  subsystem  designs  are  then  integrated,  sometimes 
in  a rather  ad  hoc  manner,  to  arrive  at  the  total  aircraft  guid- 
ance and  control  system  design. 

There  is  good  reason  for  this  process  of  decomposing  the 
large,  complex  problem  of  guidance  and  control.  Primarily,  the 
high  dimensionality  and  high  degree  of  nonlinearity  exhibited 
by  the  overall  problem  does  not  permit  direct  solution  for  an 
imp  1 ementab le  design.  Moreover,  the  widespread  success  in 
developing  practical  flight  control  systems  by  integrating  the 
individual  subsystem  designs  is  strong  indication  that  blind 
application  of  any  particular  technique  to  the  full-dimensional 
problem  is  not  warranted.  However,  it  i_s  important  that  the 
designer  have  a firm  understanding  of  the  interrelationship 
of  the  subsystems  while  he  is  designing  any  particular  one. 

In  this  wav,  oversights  and  inconsistencies  are  minimized  and  the 
design  integration  process  should  proceed  smoothly. 

To  assist  in  providing  this  insight  into  the  interrelation- 
ship of  guidance  and  control  subsystems,  this  section  defines 
a conceptual  framework  by  which  to  partition  the  path  control 
problem  for  discussion  and  analysis.  The  two  main  partitions 


of  this  framework,  reference  generation  and  perturbat ion  con- 
trol, are  then  discussed  separately. 


SYSTEM  PARTITIONING 


Many  aspects  of  aircraft  guidance  and  control  can  be  dis- 
cussed within  the  path  control  framework  illustrated  in  Figure 
IS.  This  conceptual  diagram  identifies  two  major  partitions: 

1)  the  reference  generator,  and  2)  the  perturbation  controller.  The 
reference  generation  function  determines  the  "nominal"  state 
(trajectory)  and  control  which  satisfy  the  outer-loop  control 
objectives  (guidance,  performance  optimization,  etc.).  The 
perturbation  control  function  attempts  to  maintain  the  actual 
state  near  the  nominal  (."departure  prevention")  while  simul- 
taneously satisfying  other  inner-loop  control  objectives 
(disturbance  rejection,  stability  augmentation,  etc.).  The 
perturbation  control  is  then  added  to  the  nominal  control  to  form 
the  total  control,  which  is  sent  to  the  actuation  system. 
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Figure  15.  Generic  Block  Diagram  of  a Path  Control  System 


The  basis  for  the  structure  illustrated  above  lies  in  the 
nature  of  the  linearization  process  (as  discussed  in  Section 
II)  and  in  the  related  concept  of  "neighboring  path"  optimal 
control  (Ref.  14,  Chapter  6).  In  this  concept,  the  reference 
solution  addresses  the  full-scale,  nonlinear  system  model  to 
obtain  the  optimal  "open-loop"  control  and  associated  optimal 
trajectory,  which  satisfies  outer-loop  control  objectives.  The 
perturbation  control  is  then  derived  through  linearizing  about 
this  reference  solution  and  determining  the  linear  feedback 
gains  which  minimize  deviations  from  the  reference. 

In  practice,  the  "pure"  optimal  path  and  neighboring 
optimal  path  problem  is  not  generally  addressed  in  full  dimen- 
sion. Rather,  many  simplifications  and  engineering  approxima- 
tions are  made  in  the  design  process.  These  approximations 
lead  to  a suboptimal  solution  to  the  overall  problem.  Moreover, 
such  approximations  frequently  obscure  the  interface  between 
the  two  conceptual  partitions  of  reference  generation  and  per- 
turbation control.  For  instance,  the  reference  solution  to 
the  nonlinear,  outer-loop  problem  (e.g.  minimum  time  to  climb) 
may  make  approximations  which  neglect  fast  dynamics  (e.g. 
pitch  angle  and  rate)  and  treat  certain  fast-varying  system 
states  (e.g.  flight-path  angle)  as  "artificial"  controls.  The 
output  of  the  outer-loop  problem  solution  now  consists  of 
some  of  the  reference  states  (e.g.  altitude  and  velocity)  and 
"artificial"  control  variables  (e.g.  flight  path).  Before 
this  problem  can  be  cast  in  the  path-control  framework  (Figure 
15),  nominal  values  must  be  computed  for  the  remaining  refer- 
ence states  and  the  true  reference  control  (e.g.  a "trim” 
elevator  and  nominal  thrust  history  which  are  consistent  with 
the  reference  velocity  must  be  computed).  Often  it  is  con- 
venient to  locate  such  computations  (e.g.  elevator  trim)  with 
the  inner-loop  control  functions,  i.e.  within  the  perturbation 


control  partition.  Notwithstanding  such  exceptions,  the  path- 
control  formal  structure  defined  above  is  a valid  and  helpful 
context  within  which  to  view  the  design  of  the  overall  system, 
as  demonstrated  in  the  remainder  of  this  section. 

5.  REFERENCE  GENERAT ION 

As  defined  above,  reference  generation  addresses  outer-loop 
control  objectives,  of  which  there  are  two  general  categories: 

(1)  performance  optimization  and  (2)  guidance.  The  distinction 
between  these  two  classes  is  that  performance  optimization  is 
not  generally  concerned  with  geographic  position,  but  rather 
with  the  time-optimal  or  fuel-optimal  maneuvers  or  transitions 
between  energy  states.  Guidance,  on  the  other  hand,  is  primarily 
concerned  with  position  attainment,  and  performance  optimization 
is  viewed  as  a secondary  objective. 

Many  types  of  performance  optimization  are  of  major  signi- 
ficance only  for  supersonic  or  fighter  aircraft.  Such  problems 
include  minimum-time  and  minimum-fuel  climbs,  dives,  and  turns. 

A survey  of  literature  describing  the  application  of  optimal 
control  theory  to  selected  performance  optimization  problems 
is  presented  in  Table  3.  Such  performance  optimization  problems 
are  not  considered  further  in  this  report  in  their  "pure"  form, 
but  only  as  performance  optimization  relates  to  optimal  guidance. 

For  transport  aircraft,  the  guidance  problem  is  conven- 
tionally divided  into  the  horizontal  and  vertical  planes. 

Horizontal  guidance  addresses  the  synthesis  of  trajectories 
which  overfly  prescribed  waypoints  or  avoid  hazardous  geographic 
regions,  both  without  and  with  control  of  the  time  at  which  various 
points  on  the  trajectory  are  reached  (time-of-arrival  guidance). 
Vertical  guidance  is  concerned  with  achieving  time-optimum  or 
fuel-optimum  altitude/range  profiles,  with  avoiding  vertical 


TABLE  3 

SURVEY  OF  AIRCRAFT  PERFORMANCE  OPTIMIZATION  LITERATURE 


REFERENCE 

NO. 

18 

19 

20 

21 

22 

23 

24 


PROBLEMS  ADDRESSED 


COMMENTS 


• Minimum  time  to 
climb  (change  energy 
level ) 

• Minimum  fuel  to 
cl  imb 

• Maximum  range 
profiles 


• Uses  energy-state  approximation  and 
energy  management  techniques 

• Comparison  of  approximate  and  near 
exact  solution 

• Numerical  results  for  two  represen- 
tative supersonic  aircraft 


t Minimum  time  to  gain 
energy 

• Minimum  fuel  to  gain 
energy 


• Compares  singular  perturbation 
approach  to  conventional  energy 
management  methods 


• Minimum  time  loop 
maneuver 


• Four-dimensional  state  model 

• Calculus  of  variations  approach 

• Numerical  results  for  typical  high- 
speed jet  aircraft 


• Three-dimensional 
maneuveri ng-- 
minimum-time 
transition  from 
initial  to  final 
altitude,  velocity, 
and  heading 


• Singular  perturbation  approach 

• Consider  aircraft  constraints 
(thrust  maximum,  g-limit,  etc.) 

• Numerical  example  of  F-4E  engaging 
with  F-106 


• Three-dimensional 
minimum-time  turns 


• Numerical  results  for  F-4H  aircraft 


t Three-dimensional 
minimum-fuel  turns 


• Numerical  results  for  F-4H  aircraft 


• Minimum-time  turns  • Numerical  results  for  hypothetical 
at  constant  supersonic  airplane 

altitude 


"... :: 


threat  contours,  or  with  terrain  following.  If  necessary,  three- 
dimensional  (or  three-dimensional  plus  time)  guidance  objectives 
can  be  satisfied  by  integrating  the  horizontal  and  vertical  designs. 
For  example,  the  horizontal  guidance  solution  for  total  path  length 
can  be  used  as  input  to  the  vertical  guidance  laws,  which  are  then 
solved  to  determine  the  fuel  optimum  altitude/velocity  profile  to 
achieve  this  desired  total  range.  The  horizontal  and  vertical  guid- 
ance problems  are  discussed  separately  below. 

a.  Horizontal  Guidance 

Horizontal  guidance  objectives,  as  a rule,  stem  from  two 
higher-level  concerns:  (1)  flight  management  and  (2)  threat  avoid- 
ance. Flight  management  is  concerned  with  the  synthesis  of  tra- 
jectories which: 

• pass  through  specified  waypoints  in  a controlled  manner 

• transition  from  an  initial  location  (waypoint)  and  head- 
ing to  a final  location  (or  location  and  heading) 

• intercept  and  fly  along  a line  in  a specified  direction. 

Threat  avoidance  in  the  horizontal  plane,*  of  course,  is  concerned 
with  the  avoidance  of  specified  hazardous  topographic  regions  with- 
in a given  altitude  range  so  as  to  minimize  the  exposure  to  threat 
or  maximize  the  probability  of  mission  success.  In  addition  to  these 
primary  concerns,  horizontal  guidance  objectives  frequently  include 
control  over  the  time  of  arrival  at  specified  points  along  the  path, 
notably  the  terminal  point. 


* Strictly  speaking,  the  threat  avoidance  problem  is  three- 

dimensional  , involving  the  consideration  of  altitude  as  well  as 
horizontal  position  in  order  to  avoid  the  three-dimensional  threat 
volumes.  For  illustration  here,  the  horizontal  aspects  of  the 
threat  avoidance  problem  will  be  emphasized,  with  altitude  assumed 
to  be  constrained  within  some  acceptable  range.  The  algorithm 
which  generates  the  simulation  results  presented  later,  however, 
is  capable  of  treating  the  full  three-dimensional  problem. 
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(1)  Minimum-Time  Transition 


Most  common  problems  in  horizontal  guidance  can  be 
classified  into  three  types  [25]: 

Type  1:  Flying  from  an  initial  point  and  heading  to 
a specified  final  point  and  heading; 

Type  2:  Flying  from  an  initial  point  and  heading  to 
intercept  and  then  fly  along  a line  of  spec- 
ified heading;  and 

Type  3:  Flying  from  an  initial  point  and  heading  to 
a specified  final  point  with  arbitrary  final 
heading . 

Many  more  complicated  horizontal  guidance  problems  can  often  be 
interpreted  as  a sequence  of  these  basic  problem  types. 

The  solutions  to  the  three  guidance  problems  defined  above 
are  not  unique;  i.e.,  problem  Type  1 may  be  solved  by  a number  of 
steep  turns  and  straight  path  sections  or  by  a few  sweeping  turns. 
In  the  interest  of  being  able  to  generate  ef f ic ient  and  predictable 
trajectories  for  all  initial  and  final  conditions,  it  is  reasonable 
to  ask  what  trajectory  performs  the  desired  transition  in  minimum 
t ime . 

In  formulating  the  minimum-time  optimal  control  problem,  one 
typically  uses  the  planar,  point-mass  aircraft  model: 

x = vx  (67) 

y = vy  (68) 

v = - (fj/m)  sin  ip  (69) 

X ^ 


V 


y 


(fj/m)  cos  V 


(70) 


where  <P  is  the  heading  angle  measured  clockwise  from  the  x-axis, 
i.e.: 


'■P 


tan'1  Ov/vx) 


(71) 
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and  where 


» 


x and  y are  the  coordinates  of  position  in  the  plane 
vx  and  v are  the  components  of  velocity  in  the  plane 

f,  is  the  lateral  force. 

x. 


The  lateral  force  f„  can  be  considered  to  be  the  control,  or  else 
the  bank  angle  <p  can  be  used  as  the  control,  since  the  two  are 
related  by: 

fj  = m g tan  ^ (72) 

By  convention,  positive  $ corresponds  to  right  wing  down. 


Realistically,  the  control  variable  must  be  constrained, 

either  by  specifying  a minimum  allowable  turning  radius  ^min> 

maximum  allowable  bank  angle  J>  , or  maximum  allowable  lateral 

& rmax 

force  f„  . For  constant  velocity  turns,  these  are  related  by: 
t max  ■ 


R . = V“  / (g  tan  ! ) 

min  & 1 max 1 1 


f,  - m g tan  $ 
Imax  b 1 max 


(73) 

(74) 


where  V is  the  total  aircraft  velocity  magnitude. 

The  minimum-time  transition  can  now  be  found  by  minimicing 
the  Hamiltonian: 


H = 1 + X . v ♦ X,v  + f /m  (-*-.  sin  4>  + X,  cos  *)  (75) 

i x l y k,  ° f 

subject  to  the  system  equations  (67-70)  and  control  constraint 

equation  (74).  In  the  above  equation,  the  X’s  are  the  costates 

or  LaGrange  multipliers.  The  three  types  of  guidance  problems 

defined  previously  can  be  formulated  by  specifying  appropriate 

final  conditions  on  the  state  and  costate. 

As  can  be  seen  in  Equation  (75),  the  control  variable  enters 
1 inear lv * in  the  Hamiltonian.  Application  of  the  minimum  principle 

* Rather  than,  say,  quadrat ical ly  as  in  the  linear-quadratic 
(quadratic  synthesis")  problem  described  in  Section  II. 

56 


r 


to  such  problems  results  in  a so-called  singular  solution.  This 
is  evident  since  the  necessary  condition: 

3H  = 0 = A,  sin  4*  - X , cos  'I'  (76) 

an  3 4 

does  not  result  in  expression  solvable  for  the  control  f ^ in  terms 

ol  the  state  and  costate  variables.  Instead,  for  singular  problems, 
the  control  is  found  by  the  requirement  that  Eq . (76)  be  satisfied 
tor  a finite  amount  of  timej  in  other  words,  the  time  derivative 
of  3H/3u  must  be  zero. 

Carrying  through  the  conventional  techniques  for  solving 
such  singular  problems,  it  has  been  shown  [25]  that  the  non- s ingular 
intervals  of  trajectories  consist  of  turns  with  maximum  bank  angle 
(and  hence  minimum  allowable  turning  radius)  and  the  s ingular  inter- 
vals of  optimum  trajectories  consist  of  straight-line  flight. 
Specific  optimal  transitions  for  the  three  types  of  guidance 
problems  described  above  can  be  synthesized  from  such  maximum  bank- 
angle  turns  and  straight  line  segments,  using  certain  heuristic 
rules  to  assure  the  attainment  of  prescribed  end-points  with  a 
minimum  amount  of  maneuvering. 

Application  of  the  above  to  the  horizontal  guidance  problem 
takes  on  both  off-line  and  on-line  connotations.  Off-line,  of 
course,  the  theory  can  be  used  to  synthesize  particular  flight 
plans  to  fly  prescribed  scenarios.  In  addition,  on-line  algorithms 
have  been  generated  to  synthesize  minimum  time  or  minimum  path- 
length  transition  trajectories  for  end-point  attainment.  As  an 
example,  one  such  on-line  algorithm  [26],  known  to  require  about 
10  milliseconds  on  a fixed -point  Sperry  1819A  computer  for  solution, 
has  been  successfully  used  for  trajectory  "capture"  --  in  particular 
for  the  minimum-time  nulling  of  lateral  errors  which  are  typically 
discovered  by  an  on-board  guidance  system  when  it  acquires  highly 
accurate  microwave  navigational  data  near  the  runway. 
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The  outputs  of  the  horizontal  guidance  trajectory  generation, 
then,  are  the  reference  trajectory  coordinates  xD,  vn  and  the 

which  is  nominally  zero  in  the  straight 


R’ 


reference  bank  angle 
segments  or  equal  to 
or  rate- 1 imit ing  may  also  be  used  to  "soften”  these  transitions  in 


4>mo„  during  turns.  i Command  smoothing 


command  between  zero  and 


max 


(.2)  Controlled  Time  of  Arrival 


As  mentioned  previously,  guidance  objectives  fre- 
quently include  controlled  tune  of  arrival  at  specified  points 
along  the  synthesized  reference  path.  Control  over  the  time  of 
arrival  at  an  arbitrary  point  on  the  path  can  be  exerted  either  by 
modification  of  the  total  path  length  up  to  that  point,  (e.g., 
path- stretching  maneuvers)  or  by  modulation  of  the  aircraft  speed. 
Again,  as  was  the  case  with  horizontal  flight-path  synthesis,  an 
infinite  number  of  solutions  to  the  time  of  arrival  problem  exist. 
One  solution  practical  for  many  flight  management  applications  is 
discussed  below. 

The  problem  is  to  synthesize  a speed  profile  for  a given 
reference  horizontal  trajectory  such  that  an  aircraft  starting  with 
initial  speed  VQ  at  time  tQ  arrives  as  the  final  point  at  the 
specified  time  t ^ with  velocity  V,-.  The  constraints  are  that 
the  speed  V must  be  within  the  range  of  the  minimum  ^nnn) 
maximum  (V  ) speed  restrictions  of  the  aircraft  and  that  speed 
changes  must  be  carried  out  writh  constant  acceleration  A or  de- 
celeration Aj , selected  to  fit  the  performance  of  a particular 
aircraft . 

A particular  practical  algorithm  [27]  for  solving  the  problem 
posed  above  is  described  below.  The  solution  is  broken  down  into 
three  steps. 

First,  the  algorithm  tests  the  feasibility  of  the  reference 
path  length  L by  comparison  with  L x and  ^min>  which  are 
the  maximum  and  minimum  distances  the  aircraft  is  capable  of  tr aver 
sing  in  the  allotted  time,  respectively.  If  the  path  length  exceed 


L , the  speed  profile  is  beyond  the  aircraft's  performance 
capability  of  flying,  and  a later  arrival  time  must  be  specified. 

If  the  path  length  is  less  than  Lm^n>  it  must  be  increased  so  that 
the  new  path  length  is  within  the  range  of  L . to  L , for  in- 
stance  by  using  a path- stretching  maneuver. 

Second,  the  algorithm  defines  an  appropriate  speed  profile 
consisting  of  at  most  three  segments:  an  acceleration  or  deceler- 
ation segment  starting  at  V , a constant  speed  segment  at  some 
nominal  speed  Vn , and  another  acceleration  or  deceleration  seg- 
ment ending  at  . The  definition  of  the  appropriate  speed  pro- 
file involves  two  additional  parameters  and  L 1 , which  are 

defined  respectively  as  the  minimum  and  maximum  distances  that  can 
be  travelled  in  the  allotted  time  interval  if  speed  is  constrained 
to  lie  between  VQ  and  These  parameters  correspond  to  the 

shaded  areas  under  the  speed  profiles  shown  in  Figure  16.  The 
parameters  and  L are  used  to  select  an  appropriate  refer- 

ence speed  profile  from  the  candidates  shown  in  Figure  17.  For 
example,  if  L less  than  L ^ (and  if  L passes  the  feasibility 
test  in  Step  1 above),  the  appropriate  profile  must  include  sus- 
tained flight  at  a nominal  speed  V lower  than  both  VQ  and  V^, 
as  shown  in  the  first  curve  in  Figure  17. 

Third,  the  numerical  values  of  the  parameters  in  the  selected 
speed  profile  are  determined  by  matching  the  area  under  the  selected 
curve  with  the  reference  feasible  path  length  L. 

# 

The  output  of  this  time-of-arrival  control  algorithm  is  a 
reference  speed  profile  Vp,  which  may  now  be  included  with  the 
horizontal  guidance  reference  states  x^,  y ^ , and  -as  defined 

above . 


(3)  Threat  Avoidance 

A very  promising  area  for  the  application  of 
optimization  theory  is  the  problem  of  maximizing  the  probability 
of  success  of  tactical  missions  subject  to  enemy  threats.  The 
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problem  is  twofold:  (1)  determining  the  optimal  flight  path 
through  the  threat  environment,  and  (2)  determining  the  optimal 
utilisation  of  countermeasure  resources  so  as  to  reduce  threats 
along  the  selected  path.  Obviously  and  unfortunately,  these  two 
aspects  of  the  problem  are  highly  coupled:  the  optimality  of  the 
selected  path  in  terms  of  mission  success  probability  and  proba- 
bility of  survival  is  strongly  dependent  upon  how  counter- 
measure resources  are  applied.  Conversely,  it  is  usually  best  to 
direct  countermeasure  resources  so  as  to  concentrate  on  paths 
which  exhibit  some  degree  of  optimality  in  terms  of  fuel  expend- 
iture or  total  time  of  exposure  to  threats. 

Many  simplified  approaches  have  been  taken  to  the  threat 
avoidance  problem,  with  very  limited  success.  The  main  difficulty 
lies  in  the  high  degree  of  dimensionality  incurred  by  the  strong 
coupling  of  the  several  important  factors  cited  above.  Simpli- 
fications which  neglect  certain  factors  can  be  sufficiently  sub- 
optimal  so  as  not  to  be  worthwhile. 

One  technique  which  is  highly  suited  to  such  optimization 
processes  is  dynamic  programming.  Dynamic  programming  converts 
the  problem  to  a multistage  decision  process;  the  control  solution 
is  formulated  as  the  sequence  of  decisions  which  optimizes  a multi- 
faceted performance  index  over  the  entire  trajectory.  Basically, 
dynamic  programming  converts  the  simultaneous  determination  of  the 
entire  optimal  control  sequence  into  a tractable  sequential 
solution  of  vastly  simpler  intermediate  optimization  problems. 

Historically,  dynamic  programming  solutions  to  high-dimensional 
problems  have  incurred  severe  computational  requirements.  Much  of 
this  difficulty  stems  from  the  use  of  conventional,  direct  algo- 
rithms which  attempt  to  exhaustively  search  all  possible  control 
combinations . Innovative  solution  algorithms,  however,  have  been 
developed  to  obviate  the  need  for  this  exhaustive  search.  More- 
over, advances  in  computer  architectures,  namely  the  advent  of 
highly  parallel  arrav  processors,  ideally  suit  the  dynamic 
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programming  solution  technique  of  decomposition  into  multiple  sub- 
problems. Consequently,  a dynamic  programming  solution  to  the 
sophisticated  threat  avoidance  problem  is  extremely  feasible. 

To  illustrate  the  performance  of  a particular  dynamic  pro- 
gramming algorithm,  results  are  presented  below  from  some  recent 
work  [28]  which  generates  optimum  flight  paths  and  countermeasure 
resource  allocation  for  penetrating  enemy  defenses.  The  algorithm 
is  capable  of  incorporating: 

• Three-dimensional  and  flight  direction  dependence  of 
the  lethality  of  threats, 

• Variation  in  fuel  consumption  as  a function  of  speed 
and  altitude, 

• The  effects  of  uncertainty  in  the  existence  and 
location  of  the  threat, 

• Terrain  masking, 

• Expendable  Electronic  Warfare  (EW)  resources 
(e.g.,  decoys,  chaff,  anti - radiat ion  missiles) 

• Non- expendable  EW  resources  (e.g.,  radio  fre- 
quency jamming) 

• Variations  of  aircraft  radar  cross-section  as  a 
function  of  aspect  angle,** 

• Boundary  conditions,  such  as  requiring  the  aircraft 
to  approach  the  target  from  a specific  direction, 

• Fuel  constraints. 


The  algorithm  will  make  the  optimum  tradeoff  of  available  penetra- 
tion techniques  such  as  flying  around  threats,  jamming,  decoying, 
flying  under  radar  coverage,  etc.,  to  determine  the  optimum  means 
of  penetration. 

Figure  18  shows  the  symbology  used  in  the  simulation  results 
which  follow.  As  shown,  the  threats  may  either  be  known  with 
certainty,  or  uncertainty  may  exist  in  their  actual  location* 

* Additional  "pop  up”  threats,  which  represent  those  detected 
during  the  mission  by  on-board  sensors,  can  also  be  handled 
by  the  simulation  model. 

**  I.e.,  the  angle  between  the  aircraft's  plane  of  maximum  cross- 
sectional  area  and  the  radar  1 i ne -o f - s i gh t . 
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Figure  1 
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Threats  Known  with  Certainty 


Known  position  of  threat 
Lethalitv  area  of  threat 


Threats  with  Uncertainty  in  Location 


\ 
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Actual  position  of  threat 
(not  known  to  program) 

Actual  lethality  zone 
(not  known  to  program) 


Area  of  possible  lethality 


Threats  Against  Which  Expendable  Resources  Have  Been  Applied 
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8.  Symbology  Used  in  Threat  Avoidance  Simulation  Examples 
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(all  threats  are  SAM  sites).  Threats  against  which  expendable 
resources  have  been  deployed  are  indicated  as  shown;  such  deploy- 
ment, of  course,  serves  to  reduce  the  effectiveness  of  the  threat. 

An  example  run  of  a dynamic  simulation  developed  to  evaluate 
the  threat  avoidance  algorithm  is  shown  in  Figure  19.  The  scenario 
seeks  the  attainment  of  two  objectives  T1  and  T2  in  the  presence 
of  thirteen  threats:  A1 , A2 , Bl,  B2 , B5,  B4  , BS,  Bb,  B"  , 

Cl,  C2,  C3,  and  C4 . The  location  of  some  of  the  threats  (A2 , Cl, 

C2,  C5,  C4)  are  not  known  with  certainty,  hence  the  dashed 

uncertainty  contours.  The  flight  path  shown  is  the  minimum-fuel 
solution,  which  is  used  to  start  the  algorithm  --  it  is  not  the 
final  solution.  Shown  at  the  bottom  is  the  allocation  of  Electronic 
Countermeasure  (ECM)  power  to  each  threat,  three  quantized  values 
of  chaff,  two  decoys,  and  one  Ant i - radiat ion  Missile  (ARM).  The 
fuel  used  (11,750  lbs),  probability  of  survival  (0.758),  and  the 
probability  of  accomplishing  the  first  and  second  objectives 
(Py  = 0.935,  = 0.774)  are  given  on  the  right  side.  Even 

thoigh  Figure  19  is  not  the  final  optimum  path,  the  ECM  power  is 
optimally  allocated  among  threats.  An  examination  of  the  alloca- 
tion of  radio  frequency  (RF)  power  shown  at  the  bottom  of  Figure 
19  indicates  that  RF  power  was  allocated  to  several  threats  at 
many  points  during  the  scenario.  An  example  is  shown  at  time  point 
12.20  where  the  RF  power  is  allocated  to  threats  C3  and  C4 . 

Figure  20  indicates  the  results  obtained  after  the  program 
optimizes  the  path  and  allocation  of  resources.  Note  the  large 
inciease  in  all  of  the  performance  indicators  (e.g.,  the  probability 
of  survival  went  from  0.738  to  0.887).  Also,  the  allocation  of 
many  of  the  expendables  changed  as  was  expected.  One  unit  of  chaff 
originally  allocated  to  threat  Cl  was  changed  to  A1  and  the  decov 
allocated  to  B3  was  reallocated  to  Bl.  All  expendable  EW  resources 
are  deployed  and  all  of  the  available  fuel  is  used.  This  occurs  be- 
cause allocating  a resource  results  in  increased  performance  com- 
pared to  not  allocating  the  resource;  i.e.  the  cost  penalty  placed 
on  actually  using  the  allotted  expendables  is  low  compared  to  the 
cost  penalty  associated  with  mission  failure. 
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Figure  19.  Simulation  Results  Summary  for  Example  Threat  Scenario  and  Minimum  Path  [28] 


Thus  far  the  optimum  solutions  have  all  been  based  on  a priori 
(although  probabilistic)  information.  Consequently,  the  optimum 
trajectory  solutions  could  have  been  performed  off-line  and  stored 
prior  to  the  flight.  If  onboard  sensors  or  a reconnaissance/ 
communications  system  reduce  uncertainty  in  threat  location  (or  dis- 
cover previously  unknown  threats),  radically  different  solution  tra- 
jectories and  optimum  allocations  of  resources  result.  Figure  21 
presents  such  an  example  where  on-line  recomputation  of  the  optimum 
solution  is  necessary.  As  shown,  it  is  assumed  that  the  aircraft 
has  proceeded  successfully  to  the  point  P,  at  which  time  onboard 
sensors  determined  the  actual  location  of  threat  Cl.  This  elimi- 
nates the  uncertainty  in  Cl's  location  as  indicated  by  the  removal 
of  the  dashed  circle  around  Cl.  The  new  allocation  of  resources 
and  flight  path  is  shown.  Since  the  flight  path  to  objective  T1 
is  more  direct  than  in  Figure  20,  more  fuel  is  available  to  fly 
around  threats  C2  and  C5.  This  caused  a reallocation  of  a decov 
from  B1  to  B5  and  a reallocation  of  chaff  from  C2  to  A2. 

With  this  new  allocation  and  flight  path,  the  probability  of  sur- 
vival increased  to  0.897.  Results  of  this  nature  were  also  obtain- 
ed when  previously  unknown  "pop-up  threats  were  introduced. 

Computer  resource  requirements  for  executing  (on-line)  the 
dynamic  programming  algorithm  discussed  above  are  not  prohibitive. 

Even  the  d i rect - search , serial  processing  form  as  implemented  on 
a Univac  1108  (1  p sec  cycle  time)  takes  less  than  8 minutes  for 
complete  solution.  Using  the  implicit  stage  algorithm  can  reduce 
this  to  less  than  8 seconds ; however,  this  algorithm  has  the  unde- 
sirable  property  of  prohibiting  transitions  back  toward  the  start- 
ing point.  This  difficulty  is  alleviated  by  other  mathematical 
techniques,  such  as  the  method  of  successive  approximations,  which 
can  obtain  an  approximate  solution  on  a serial  processor  in  about 
10  seconds  to  a minute.  Far  greater  speed  improvements  (1000/1 
speed  up)  are  possible  if  off-the-shelf  parallel  processors  are 
employed.  This  occurs  because  the  computations  necessary  to 
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Figure  21.  Optimum  Might  Path  Four  Minutes  Into  the  Flight  Assuming 

Uncertainty  in  Threat  Cl  F.liminated  Due  to  Onboard  Sensors  [28] 


determine  the  optimum  transition  for  all  states  at  a given  stage 
are  independent  of  each  other  and,  therefore,  can  be  performed  in 
parallel.  Typically,  the  designer  will  use  such  a dramatic  im- 
provement in  processing  speed  capability  to  obtain  a more  accurate 
solution  while  letting  solution  time  approach  some  reasonable 
number  (say  50  seconds) . This  is  usually  done  by  reducing  the 
"granularity"  of  the  solution,  i.e.,  by  breaking  the  optimization 
problem  up  into  a greater  number  of  stages. 


The  preceding  has  shown  an  implementable  basis  for  reference 
generation  in  the  horizontal  plane  which  is  an  alternative  to  con- 
ventional two-dimensional  horizontal  guidance.  The  outputs  to  the 
inner  loop  are  the  same,  however,  namely  the  reference  positions 
in  the  horizontal  plane  xR  and  y R and  the  velocity  magnitude 
VR.  Nominal  bank  angles  for  required  turns  can  also  be 

synthesized  by  relating  bank  angle  to  turn  radius  R by  using  the 
relat ion : 


R = VR/ (g  tan  | 0R! ) (77) 

b.  Vertical  Guidance 

Typical  objectives  of  aircraft  guidance  in  the  vertical 
plane  are  the  generation  of: 

• Time-optimum  or  fuel-optimum  altitude  profiles  to  achieve 
a given  altitude  and/or  range  transition; 

• Profiles  to  maximize  range  for  a given  thrust  level  and 
fuel  allotment  ; 

• Commands  to  follow  terrain  or  avoid  vertical  threat  con- 
tours while  simultaneously  optimizing  other  aspects  of 
performance  (e.g.,  minimum  throttle  activity). 

A moderate  amount  of  work  has  addressed  optimal  control  solutions 
to  these  vertical  guidance  problems,  notable  Refs.  [18],  [19]  and 

[29]  through  [32].  Most  of  the  practical  on-line  implementations 
of  these  solutions  derive  from  the  application  of  the  so-called 
"energy  management  (EM)"  methods. 
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The  EM  methodology  is  characterized  by  order- reduct  ion 
approximations  to  the  point-mass  longitudinal  equations  of  air- 
craft motion.  In  particular,  the  energy  state  approximation  (see 
Appendix!  is  used  to  eliminate  the  dynamic  equations  for  velocity 
and  flight  path  angle  in  favor  of  a single  dynamic  equation  in 
the  energy  state : 

E = (T- D) V/m  (78) 

where  E is  the  total  (sum  of  kinetic  and  potential)  energy  per 
unit  mass , i . e : 

E = 1/2  V2  + gh  (79) 

and  where 

T is  the  thrust 

D is  the  drag 

V is  the  velocity  magnitude 

m is  the  mass 

h is  the  altitude 

g is  the  acceleration  of  gravity 

Thrust  is  assumed  to  be  a function  of  altitude  (h) , velocity,  and 


throttle  setting  (tt)  : 

T = T ( h , V , tt ) (SO) 

and  drag  is  a function  of  altitude  and  velocity: 

D = D(h,V)  (81) 

The  other  dynamic  equations  retained  in  the  EM  methodology  arc: 

i = V (82) 

m = f ( h , V ) (83) 


"0 


where  x is  the  along-track  position  coordinate  and  f is  the 
fuel  flow  rate.  In  the  equations  above,  both  angle-of-attack  and 
flight-path  angle  are  considered  small,  and  lift  equals  weight. 

Before  exploring  some  illustrative  examples  of  the  EM  method- 
ology, it  is  appropriate  to  note  several  important  points: 

• Certain  problems  are  addressed  by  i n t e r c ha n g i n g variables 
in  the  I'M  equations.  For  example,  specific  energy  F 

may  be  used  as  the  state  variable  and  time  as  the  indepen- 
dent variable  in  one  type  of  problem,  but  in  another,  it 
may  be  convenient  to  divide  Eq . (“81  by  Eq . i85)  to  change 

the  independent  variable  from  time  to  mass. 

• EM  app rox ima t 1 ons  generally  treat  either  h or  \ as  the 
control  variable,  since  the  dynamics  of  these  quantities 
are  neglected  and  the  derivatives  of  the  state-  i F. ,m  .etc  . 1 
can  be  expressed  in  terms  of  these  variables.  V and  h 
can  be  related  to  one  another  and  to  the  state  1 by 

Eq.  (79). 

• In  the  context  of  an  optimal  control  problem,  th<  > n 
state  approximations  imply  that  the  control  variable  h 
or  V varies  slowly  over  most  of  the  trajectory,  but  it 
may  contain  discontinuities  and  rapid  variations  confined 
to  narrow  regions.  Various  extensions  to  the  EM  methodol- 
ogv  have  been  developed,  for  example  by  using  singular 
perturbation  theory  to  provide  corrections  to  the  approx- 
imate solution  through  analysis  of  the  h and  V dyna- 
mics in  a "stretched"  time  scale  [19]  (see  Section  II). 


(1)  Minimum  Time  to  Climb 

Perhaps  the  most  easily  discernible  application  of  EM 
methods  is  determining  the  altitude/velocity  profile  which  mini- 
mites the  time  to  climb  to  a specified  energy  level.  Minimising 
the  time  to  change  energy  levels  is  equivalent  to  maxim i sing  the 
rate  of  change  o'  energy  E (Eq.  (78)).  Thus,  the  approximately 
optimal  reference  velocity  (V^)  profile  is  the  one  which  maximises 
E for  a given  E,  or  mathematically: 

VD  = arg  (max [ (T(E , V) -D(E, V) ) V/m ] } 

R V 


(84) 


which  can  be  read  "V„  is  the  value  of  V which  maximizes  the 
expression  [(T-D)V/m]  with  respect  to  V." 

When  this  expression  (Eq.  (84))  for  the  approximately  optimal 
control  is  evaluated  numerically,  a solution  path  similar  to  that 
shown  in  Figure  22  typically  results.  The  path  is  characterized 
by  portions  which  satisfy  Eq . (84),  connected  by  portions  of  con- 

stant energy  contours.  Thus,  the  approximately  minimum-time  path 
from  point  A'  on  energy  level  E ^ to  point  G on  energy  level 
E?  is  given  by: 

• a rapid  dive  to  B' 

• motion  along  the  optimal  segment  B 'C  to  point  C 

• a rapid  dive  to  D* 

• motion  along  the  optimal  segment  DF  to  F 

• a rapid  climb  (zoom)  to  G. 


Figure  22.  Typical  Minimum-Time  Climb  Path 
to  Higher  Energy  Level  [IS] 


This  rapid  dive  is  characteristic  of  transonic  trajectories, 
where  for  certain  aircraft  it  becomes  more  economical  to  gain 
velocity  very  quickly  (by  diving)  so  as  to  get  through  Mach  1 as 
rapidly  as  possible. 


As  shown  in  the  figure,  the  approximately  optimal  path  as 
derived  from  EM  methods  exhibits  discontinuities  in  the  control 
variable  V,  which  appear  as  corners  in  the  profile.  These  dis- 
continuities stem  from  the  energy  state  approximation,  which 
neglects  the  dynamics  of  V and  assumes  that  V and  h can  be 
traded  instantaneously  at  constant  energy  levels  using  the  relation 

h = (E  - 1/2  V “ ) /g  (85) 

More  accurate  solutions  (four-dimensional  state,  numerical  solu- 
tion by  the  gradient  method)  do  not  exhibit  such  discontinuit ies 
(Figure  23),  although  overall  agreement  is  good  between  the  more 
accurate  method  and  the  much  easier  approximate  EM  method.  A 
singular  perturbation  approach  lias  been  used  [19]  to  analyze  the 
discontinuities  of  the  approximate  method  and  compute  corrections 
which  effectively  smooth  the  corners  in  the  approximate  solution. 
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Figure  23.  Comparison  of  "Exact"  and  Energy-State 
Minimum  Time - to-Cl imb  Paths  [IS] 


The  reference  quantities  generated  by  the  minimum  time-to- 
cliinb  solution,  then,  are  reference  velocity  Vj,  and  reference 
altitude  h^.  While  these  quantities  are  considered  "controls"  by 
the  outer-loop  solution,  they  are  nevertheless  states  of  the  over- 
all path  control  problem.  Calculation  of  the  remaining  reference 
states  and  reference  controls  from  these  key  reference  quantities 
is  discussed  in  Paragraph  C below. 


(2)  Minimum  Fuel  Problems 


Application  of  EM  methods  to  minimum  fuel  problems 
often  involves  a change  of  independent  variable  from  time  to  mass. 
This  is  done  by  dividing  Eq . (83)  into  Eq . C~8): 


dE  _ V (.  T - D ) (.86) 

3m  m7 

Minimizing  the  fuel  used  to  change  energy  levels  is  equivalent  to 
maximizing  dE/dm,  the  rate  of  energy  gain  per  change  in  mass. 

Thus,  th*  approximately  optimal  reference  velocity  for  fuel -minimum 
climb  is: 


V’n  = arg  Jmax  [[T-D)V/mf]}  (87) 

K " V 

An  example  [25]  approximately  minimum- fuel  climb  path  is  shown 
in  Figure  24.  For  comparison,  a standard  recommended  economical 
climb  path  (.an  0.75  Mach  climb)  is  also  shown.  The  near  optimal 
method  saves  289  pounds  of  fuel,  or  15.5  percent  of  the  nominal 
expenditure,  for  the  example  aircraft  in  a cLimb  to  30,000  feet. 

(3)  Maximum  Range  Problems 

Application  of  EM  methods  to  maximum  range  problems 
typically  involves  a change  of  independent  variable  from  time  to 
range  coordinate.  This  is  done  by  dividing  Eq . (82)  into  Eq . (.78) 
and  Eq . (83)  : 

"4 


1 


= ( T - D ) / m 


dm 

31 


= f/V 

To  find  the  trajectory  which  minimises  fuel  over  a specified 
range  [x0,  x ] , one  can  minimize  the  total  mass  change  subie< 
the  energy  state  constraint;  i.e.,  tlie  cost  function  is: 


J » 


/ 


xf  f 

T 


(,T-D)/m)  dx 


Thus  the  approximately  optimal  reference  velocity  is  given  by 
Vc  = arg  {min[^  + X (T-D)/m]  } 

K v 
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Figure  24.  Comparison  of  Minimum-Fuel  Climbs  Using 

Standard  Flight  Profile  and  Approximately 
Optimal  Path  at  Military  Thrust  [25] 
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Figure  25  shows  a typical  altitude/velocity  profile  for  an  approx 
imately  minimum-fuel  climb,  cruise,  and  descent  to  zero  altitude 
at  a specified  range.  Figure  26  presents  corresponding  plots  of 
altitude  and  fuel  versus  range  [25]. 
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Figure  25.  Mi n imum - Fue 1 Climb,  Cruise,  Descent 
Altitude  versus  Mach  Number 
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Figure  26.  Minimum-Fuel  Climb,  Cruise,  Descent 
Altitude  and  Fuel  versus  Range 


(4 ) Minimum  Direct  Operating  Costs 


Instead  of  minimizing  the  fuel  usage  alone  over 
a fixed  range,  it  may  be  more  desirable  to  minimize  a combination 
of  fuel  and  transit  time,  expressed  in  terms  of  direct  operating 
costs.  Thus,  the  cost  function  to  be  minimized  is: 

J = cf  mf  + ct(tf  - tQ)  (92) 

where  ct-  and  c t are  the  unit  costs  of  fuel  and  time,  respectively, 

m^  is  the  mass  of  fuel  burned,  and  (t c - t ) is  the  transit  time, 
t to 

In  integral  form,  the  cost  can  be  written: 


where 


f 


i s 


o 

the  fuel  burn  rate. 


ct)  dt 


(93) 


Solution  for  the  altitude/range  profiles  which  minimize  direct 
operating  costs  (Eq.  (93))  subject  to  the  approximate  state  dynamics 
(Eqs.  (78)  through  (85))  can  now  be  addressed  using  the  minimum  prin- 
ciple. Typically,  a change  of  variable  as  exemplified  by  Eqs.  (88) 
through  (90)  is  again  used.  Reference  [30]  presents  some  results 
for  subsonic  turbofan  aircraft  with  the  restriction  that  the  solution 
trajectory  consist  of  three  segments:  a monotonic  climb  to  cruise 
energy  level,  a segment  of  optimal  subsonic  cruise,  and  a monotonic 
descent  to  the  final  energy  level. 


(5)  Terrain-Following  Guidance 

The  primary  objective  of  terrain - fol lowing  guidance 
is  to  minimize  exposure  to  the  enemy  by  producing  flight  paths  which 
lie  as  close  to  all  terrain  points  as  possible.  To  be  practical, 
however,  the  terrain- fol lowing  guidance  should  produce  reference 
trajectories  which  can  be  followed  extremely  well  by  actual  aircraft. 

The  terra  in- fol lowing  control  systems  that  are  currently  on 
operational  aircraft  compute  flight-path  angle  commands  based  on 
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a "critical"  point  on  the  terrain  ahead  of  the  aircraft.  For  dif- 
ferent systems,  the  methods  vary  for  determining  which  point  is 
currently  the  most  critical.  Since  it  is  the  flight-path  angle, 
or  slope,  that  is  directly  controlled,  the  actual  vehicle  path  is 
not  tightly  controlled.  The  path  is  the  integral  of  the  slope  with 
respect  to  range;  therefore,  the  height  error  is  the  integral  of 
the  total  slope  errors,  which  are  due  to  both  sensor  errors  and 
control  system  implementation  errors  [31].  Operational  terrain- 
following systems  also  rely  on  manual  throttle  control  or  on  auto- 
throttles which  attempt  to  maintain  nearly  constant  speed;  neither 
of  these  methods  provides  efficient  engine  operation,  in  terms  of 
both  engine  life  and  fuel  consumption. 

To  overcome  these  difficulties,  recent  research  has  been 
directed  toward  total  path  control,  as  opposed  to  the  single 
"critical"  point  techniques  discussed  above.  Focusing  on  the 
total  path  also  allows  simultaneous  consideration  of  secondary 
objectives,  such  as  meeting  checkpoint  times  (controlled  time  of 
arrival)  or  optimising  engine  performance  (engine  life  or  fuel 
consumption) . 

One  of  the  total  path  techniques  is  based  on  the  cubic  spline* 
reference  path  [32].  The  concept  is  illustrated  in  Figure  2~ 

(p.  82).  As  shown,  the  reference  altitude  h^  path  is  tangent 
to  the  minimum  clearance  curve,  but  must  be  above  it  when  the  cur- 
vature of  the  terrain  (and  hence  the  clearance  curve)  is  suffi- 
ciently sharp  as  to  exceed  the  acceleration  capability  of  the  air- 
craft. The  total  solution  path  is  formed  by  parametrically  opti- 
mising the  cubic  spline  form  subject  to  the  operational  constraints 
(g-limits,  etc.)  imposed.  Using  the  differentiability  property  of 
the  cubic  spline,  the  optimisation  procedure  can  generate  not  only 
the  reference  altitude  profile  h^  but  also  the  rates  of  change 

* A cubic  spline  is  a continuous  curve  consisting  of  cubic 
polynomial  segments  pieced  together  such  that  the  curve 
has  continuous  first  and  second  derivatives. 
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hp  and  hR.  These,  in  turn,  can  be  used  to  establish  a complete 
and  consistent  set  of  reference  states;  for  example,  Yp  can  be 
found  from  hR  by  the  relation: 

hR  = VR  sin  yR  (94) 

once  the  reference  velocity  VR  is  established. 

Reference  velocity  can  be  determined  so  as  to  satisfy  any  of 
the  secondary  guidance  objectives  cited  above.  For  example,  the 
velocity  which  corresponds  to  sustained  flight  at  a desired,  allow- 
able energy  level  may  be  selected  as  reference.  Such  3n  example  is 
illustrated  by  Figure  28,  which  shows  the  given  potential  energy 
(ghR)  and  the  minimum  and  maximum  total  energy  (potential  plus 
kinetic)  corresponding  to  sustained  flight  at  the  minimum  and  max- 
imum allowable  velocities  (V  . and  V ).  The  figure  illustrates 
allowable  constant  energy  levels;  i.e.,  those  which  lie  tctallv 
within  the  allowable  corridor  over  a reasonable  range.  Any  of  these 
allowable  energy  levels  could  be  selected  as  the  reference  En)  , 
say,  on  the  basis  of  fuel  consumption,  engine  life,  mission  timing, 
etc.  The  corresponding  reference  velocity  is  then  found  from: 

VR  = v/2  (Er  - ghR)  (95) 

c.  Calculation  of  Remaining  Reference  Quantities 

The  preceding  has  presented  several  guidance  techniques 
which  can  be  used  to  determine  optimal  reference  values  of  selected 
state  variables.  The  path-control  concept,  however,  requires  re- 
ference values  for  all  states  and  controls  considered.  The  cal- 
culation of  the  remaining  reference  states  and  nominal  controls 
is  not  a trivial  matter,  since  all  the  reference  quantities  must 
be  mutually  consistent  if  the  overall  design  is  to  approach  optim- 
ality. A very  simple  example  of  calculating  such  a "residual" 
reference  state  is  by  using  the  expression  for  heading  rate  during 
a coordinated  turn: 
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Figure  27.  Cubic  Spline  Reference  Path  [32] 


Figure  28.  Energy  Constraints  Used  to  Determine  V 


(96) 


= f.  tan 

V R 

Thus,  given  the  reference  bank  angle  the  consistent  reference 

heading  rate  ^ is  given  approximately  by  Fq . (.96). 

More  frequently,  however,  the  designer  must  revert  to  a de- 
tailed, six  degree  of  freedom  nonlinear  model  of  the  aircraft 
(see  Appendix)  in  order  to  generate  a complete  and  consistent  set 
of  references.  Frequently,  iterative  solutions  of  these  nonlinear 
differential  equations  are  required,  or  approximation  techniques 
are  used  to  reduce  computational  burden.  Further  discussion  of 
such  techniques  is  beyond  the  scope  of  this  report. 


PERTURBATION  CONTROL 


In  the  context  of  the  path  control  problem,  the  primary  ob- 
jective of  the  perturbation  control  function  is  the  accurate  and 
efficient  tracking  of  the  reference  state.  Accurate  tracking,  or 
"departure  prevention",  serves  to  enhance  the  effectiveness  of  the 
reference  generation  function  in  achieving  over-all  path-  control 
objectives.  Constraining  the  departure  from  the  reference  has  the 
added  benefit  that,  by  so  doing,  the  linearity  assumptions  upon 
which  the  perturbation  feedback  controller  design  is  based  are 
indeed  valid.  Secondary  objectives  of  the  perturbation  control 
function  are  disturbance  rejection,  robustness  (i.e.,  the  reduction 
in  sensitivity  to  uncertainty  in  the  controller  design  parameters), 
and  stability  augmentation. 

The  methods  used  to  achieve  these  objectives  are  many  and 
varied.  Historically,  classical  f requency-domain  techniques  have 
been  used  to  design  simple  analog  or  digital  control  loops  to  ad- 
dress the  objectives  on  an  individual  basis.  As  air  vehicles  have 
increased  in  complexity  (e.g.,  additional,  redundant  actuators)  and 
mission  objectives  have  increased  in  sophistication  (e.g.,  path 
control),  classical  methods  have  given  way  to  proven  multivariable 
techniques  for  linear  system  design.  Often,  a design  is  formulated 
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using  the  more  comprehensive  (and  direct)  linear  multivariable 
techniques  and  checked  at  various  operating  points  or  flight  con- 
ditions using  a classical  analysis. 

For  illustration,  two  perturbation  controller  design  examples 
are  presented  below,  each  utilizes  a different  design  concept. 

a.  Lateral-axis  Perturbation  Control  Design  by  Pole  Placement 
Methods 

For  simplified  motion  in  the  lateral  plane,  only  five 
states  need  be  considered.  These  states,  expressed  in  terms  of 
their  reference  values  and  perturbation  values,  are: 

x ■ XR  * Sx 

y * yR  - sy 

* = '^R  + S'\>  (97) 

V = VR  ♦ 6V 
4>  = + $4> 


The  reference  values  and  their  rates  of  change  (if  needed)  are 
assumed  to  have  been  computed  by  the  reference  generator. 

The  objective  is  to  obtain  a closed-loop  control  system  which 
will  keep  the  perturbation  values  small.  A classical  pole-placement 
technique  will  be  used  for  this  example. 

The  first  step  in  the  technique  [27]  is  to  derive  an  adequate 
linear  model  of  the  aircraft  state  perturbation  dynamics.  The  de- 
rivation begins  with  a highly  simplified  nonlinear  model: 


x = V cos 
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V sin 

(S/V)  tan  t 


198) 


^ > t i i st  -order  variations  are  taken  on  E q . (98)  about  the 
reference  state: 

5x  = -VR  sin  + cos  ^R:V 

6v  = VR  cos  'I'  Sty  + sin  ^r5V  (99) 

6'?  = (g/VR)  sec“q  6<j>  - C'^R/VR)5V 

To  eliminate  the  sin  tyR  and  cos  tyR  terms,  Eq . (99)  is  rotated 
into  the  "moving  target  coordinate  system"  by  the  rotation: 


— 

— 

i X ' 

cos  tyD  sin 

K 

% 

f X 

5y ' 

_ ’ - 

- sin  T cos 

h 

'r  _ 

• y 

(100) 


As  shown  in  Figure  29,  this  coordinate  system  is  attached  to  the 
reference  or  "phantom"  position  and  oriented  along  the  reference 
direction  of  travel. 

The  linear  perturbation  model  in  the  moving  target  coordinate 
system,  then , is : 


Sx ' = 6 V + tyR6v'  (101) 

Sy'  = Vr6*  • tyR6x'  (102) 

= (g/VR)  sec “4>r6i))  - CVVR)  iV  (103) 

As  noted  in  Eqs.  (101)  and  (102),  the  linearised  equations  are 
coupled  through  the  reference  heading  rate  tyR , which,  along  with 
VR  and  <pRI  is  a parameter  of  the  model. 

Choosing  bank  angle  and  velocity  magnitude  as  the  control 
variables  and  using  an  empirically  derived  model  of  the  aircraft/ 
stability  augmentation  system,  an  over-all  perturbation  feedback 
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29.  Moving  Target  Coordinate  System  [27] 


control  system  can  be  synthesized  according  to  the  structure  shown 
in  Figure  30.  The  perturbation  control  law  can  be  expressed  in  the 
state  feedback  form: 


4«fb  ■ -k»y6y'-  Vrs*  * k»xVx 


5vfb  ' -kvxSx'  - Vr4’' 


(104) 

(105) 


The  feedback  gains  are  selected  so  as  to  achieve  a desirable 
closed-loop  configuration  over  a wide  range  of  the  parameters  , 
VD  and  $D.  A preliminary  eigenvalue  analysis  indicates  that 
a reasonable  response  is  achieved  by  using  0.000186  rad/ft  for 
k.^,,  0.003865  rad/(rad  (fps)]  for  k ^ , 0.0001  rad/[ft  (rad/sec)] 

for  k^x,  0.0444  (fps)/ft  for  kyx , and  0.15  (fps)/[ft  (rad/sec)] 
for  K . This  combination  of  gain  constants  was  obtained  bv  trial 
and  error  using  root-locus  analysis  of  the  system  of  equations. 

The  eigenvalues  corresponding  to  this  set  of  gains  yield  reasonable 
frequency  and  damping.  Figure  31  shows  three  branches  of  the  root 
locus  plot  for  this  set  of  gains  as  a function  of  , ranging 
from  0°/sec  to  6°/sec.  The  dashed  and  solid  lines  are  root  loci 
of  a system  with  and  without  the  cross  feedback  gains  k.„  and 

. <pX 

k . At  = 0°/sec,  the  damping  ratio  for  the  upper  and  lower 

branches  are  0.52  and  0.86  respectively.  At  ^ = 6°/sec,  the 
damping  ratio  for  the  upper  branch  is  0.23  for  a system  with  cross 
feedback  and  0.15  for  a system  without  cross  feedback  and  for  the 
lower  branch,  it  is  0.82  for  the  system  with  cross  feedback  and 
0.78  for  the  system  without  cross  feedback.  The  root  loci  illu- 
strate a definite  improvement  on  system  stability  by  using  cross 
feedback . 


REDUCED  ORDER  AIRCRAFT/SAS  MODEL 


Figure  30.  Structure  of  the  Perturbation 
Feedback  Control  System 


:.sz 


' /V 


/ 


■0  . ' 5 


*0.73 


V 


’*0.&2 

;«0.£6  iR  = 0'/seC 
' sec  tp=0°/sec 


.10 


4 35 


-.15 


-.10 

3.  1/sec 


Figure  31.  Root  Locus  of  Closed-Loop  Feedback  Systems  [27] 
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b.  STOL  Flare  Autopilot  Design  by  Quadratic  Synthesis 


Linear  regulator  theory  (.linear-quadratic  design  or  quadra- 
tic synthesis)  provides  a basis  for  the  design  of  controllers  which 
follow  a desired  output  state.  While  the  usual  quadratic  synthesis 
procedure  outlined  in  Section  II  may  be  adequate  for  minimizing  the 
average  departure  from  the  reference,  much  tighter  tracking  of  a 
particular  reference  state  component  (e.g.,  altitude  profile)  may  be 
required.  One  way  of  providing  this  increased  tracking  capability 
is  to  put  tracking  error  directly  into  the  cost  functional.  In  this 
way,  the  feedback  gains  derived  from  quadratic  synthesis  are  exactly 
those  which  optimize  tracking  of  the  reference.  Unfortunately,  sol- 
ution of  the  optimal  linear  tracking  (or  "servomechanism"!  problem 
involves  the  computation  of  an  additional  open- loop  control  term, 
the  solution  for  which  depends  upon  the  entire  desired  profile.  Thus 
the  entire  profile  must  be  known  a priori  in  order  for  the  solution 
to  be  realizable.  While  this  restriction  is  severely  limiting,  the 
tracking  problem  does  have  practical  validity,  as  illustrated  in  this 
section  for  the  example  where  a desired  altitude  profile  is  tracked 
during  the  aircraft  flare  maneuver. 

The  purpose  of  the  flare  maneuver  is  to  reduce  the  aircraft 
rate  of  descent  just  prior  to  touchdown  during  landing.  The 
touchdown  should  be  made  at  a sink  rate  less  than  2 ft/sec  to  meet 
structural  and  passenger  comfort  constraints.  The  nonzero  sink 
rate  is  desired  to  decrease  touchdown  dispersion.  The  2 ft/sec 
sink  rate  corresponds  to  a flight  path  angle  of  -0.5°  for  con- 
ventional takeoff  and  landing  (CTOL)  operations  using  an  airspeed 
of  130  knots  (230  ft/sec);  it  corresponds  to  about  -1.0°  for 
short  takeoff  and  landing  (STOL)  operations  using  an  airspeed  of 
65  knots  (110  ft/sec).  The  flare  maneuver  is  necessary  because 
the  approach  to  the  runway  must  be  made  at  a considerably  steeper 
flight  path  angle  than  is  acceptable  for  touchdown.  Steeper  flight 
path  angles  reduce  ground  noise  near  the  airport,  avoid  obstacles, 
and  make  the  touchdown  point  more  orecise.  Conventional  aircraft 
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operations  use  a flight  path  angle  of  about  -2.5%  during  approach; 
STOL  operations  use  a flight  path  angle  of  about  -7.5°.  Figure  32 
illustrates  a typical  flare  maneuver  for  STOL  aircraft. 
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Figure  32.  Typical  STOL  Flare  Maneuver  [33] 


The  flare  autopilot  must  manage  a number  of  state  variables 
so  as  to  effect  a smooth  glide-path  transition,  restrain  terminal 
error  to  acceptable  bounds,  and  obey  constraints  (e.g.,  maximum 
angle-of -attack  or  flap  limits)  along  the  path.  Moreover,  partic- 
ularly for  STOL  vehicles,  the  autopilot  can  make  use  of  a number 
of  control  effectors  --  elevator,  speed  (thrust),  nozzle  deflection 
(for  vector  thrust  vehicles),  flap  deflection,  etc.  Clearly,  this 
is  a problem  well  suited  to  multivariable  design  techniques,  such 
as  the  1 inear -quadrat ic -opt imal  design  (quadratic  synthesis, 

Section  II). 


see 


As  usual,  the  quadratic  synthesis  procedure  begins  with  a 
linear  model  of  the  STOL  aircraft.  The  state  variables  are  again 
divided  into  reference  and  perturbation  values. 

V = VR  + 6 V 

Y = Yr  + 6y 

e = 9r  + 60  (106) 

q = 0 + 5q 
h = hR  + 6h 

where 

V is  the  velocity 

Y is  the  flight  path  angle 
9 is  the  pitch  angle 

q is  the  pitch  rate 
h is  the  altitude 

The  controls  are 

e = eR  ♦ 6e 

n = nR  + 6n  (107) 

T = TR  + «T 

F " Fr  * 0 

where 

e is  the  elevator  deflection 

n is  the  nozzle  deflection  (thrust  vector) 

T is  the  thrust 

F is  the  flap  setting  (fixed  at  the  value  FR) 
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The  linear  perturbation  equations  with  coefficients  evaluated  at 
the  indicated  reference  conditions  are  shown  in  Figure  33;  the 
selected  STOL  aircraft  is  the  NASA  Ames  Augmentor  Wing  Jet  STOL 
Research  Aircraft  (AWJSRA) . 

Key  to  the  design  is  the  definition  of  an  appropriate  desired 
altitude  "error"  profile*  6hQ  for  the  perturbation  controller 
to  follow.  One  reasonable  choice  [33]  is  simply  an  exponential 
fit  through  the  initial  altitude  error  <5hQ  and  meeting  a zero 
altitude  terminal  condition: 


$hD(t)  = 6hQ  exp(-t/xh)  (108) 

where  the  time  constant  parameter  is  defined  so  as  to  match 

end  conditions. 

The  desired  altitude  error  profile  enters  the  controller  de- 
sign through  the  performance  index,  as  follows: 


J = j6xTSf6x  + j j f (m6x  - 6hD(t))2Wh  + 


(109) 


6uTW  6u 


dt 


where  S^,  W^,  and  are  the  usual  penalty  weights  and  M is 

the  1x5  matrix  that  picks  out  the  altitude  state  error  for 
comparison  with  6hD: 


M - [00001] 


(110) 


In  other  words,  the  desired  altitude  hp  is 
"error"  from  the  desired  terminal  condition 


thought  of  as  an 
h (tf)  = 0. 
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where 


ix  ■ F£x  ♦ G<5u 


5x  • { Sv 

5Y  46 

Sq  4 h] 

T 

6u  * ,r  5e 

5n  4 7} 

T 
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Figure  33.  Longitudinal  Dynamics  of  Typical 

STOL  Airctaft  [33] 
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The  performance  index  (Eq.  (109))  penalizes  along-path  deviations 
from  the  desired  altitude  error  profile.  This  is  the  tracking 
servomechanism  problem  of  linear  regulator  theory  (see  Ref.  17, 
Section  5.2).  The  solution  is,  using  the  backward  sweep  method 
of  Section  II: 

Su  = - Wu1GT(S5x  + £)  (111) 

where  S is  the  Riccati  matrix,  obtained  by  the  solution  to  the 
Riccati  Equation: 

S - -SF  - FTS  + SGW^j1GTS  - MTWhM  (112) 

and  £ is  the  vector  of  control  driving  terms*,  which  satisfy: 

| = |-FT  ♦ SGW* XGT  j £ + MTWhShD  (113) 

Numerical  values  were  found  in  [33]  for  the  time-varying 
feedback  gains  of  Eq  (111)  : 

K = -W'1GTS  (114) 

x u 

and  the  control  driving  terms  The  numerical  values  correspond 

to  the  terminal  and  along-path  weightings  (i.e.  square-root  of  the 
reciprocals  of  the  diagonal  elements  of  S^,  W^,  and  Wu)  as 

shown  in  Table  4.  An  altitude  profile  generated  by  the  perturba- 
tion control  law  in  a linear  simulation  is  shown  in  Figure  34.  As 
can  be  seen,  the  reference  desired  altitude  profile  is  tracked 
very  closely. 


* Such  an  additional  terra  appears  in  the  solution  to  the  regulator 
problem  either  when  the  regulator  must  track  a desired  output 
or  when  the  plant  is  driven  by  a non-white  noise  or  disturbance 
vector  [17] . 
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TABLE  4 

TERMINAL  AND  ALONG-PATH  WEIGHTINGS  FOR  FLARE  AUTOPILOT  DESIGN 


' 


» 


Variable 


6v 

6y 

60 


Terminal  Weight  Along-Path  Weight 

(i.e.,  max  value)  (i.e.,  max  value) 

5 ft/sec 

1° 

3° 


6q 


°/sec 


6h  2 ft  4 ft 

6e  - 2° 


6n  - 10° 

6T  not  used  not  used 


Figure  34.  Altitude  vs.  Range  from  Linear  Simulation 
Using  Time-Varying  Feedback  Gain 
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SECTION  IV 

CONCLUSIONS  AND  RECOMMENDATIONS 


1.  CONCLUSIONS 

The  path-control  framework  has  been  shown  to  be  a useful 
formal  structure  for  addressing  a large  number  of  modern  air- 
craft guidance  and  control  problems.  The  structure  has  two 
main  functional  partitions:  (1)  a reference  (trajectory) 
generator  and  (2)  a perturbation  controller.  The  reference 
generation  partition  encompasses  such  "outer  loop"  control  func- 
tions as: 

• horizontal  guidance,  including  controlled  time  of 
arrival 

• threat  avoidance 

• performance  optimization 

• vertical  guidance,  including  range  maximization 
and  terrain  following. 

The  perturbation  control  function  attempts  to  prevent  departures 
from  the  reference  while  simultaneously  addressing  such  "inner 
loop"  control  objectives  as  disturbance  rejection,  insensitivity 
to  parameter  variations  ("robustness"),  and  stability  augment- 
at ion . 

Methods  which  have  been  applied  to  the  design  of  reference 
generators  and  perturbation  controllers  are  many  and  varied. 
Typically,  the  control  objectives  addressed  by  reference  (tra- 
jectory) generation  require  that  optimization  methods  be  applied. 
Often  this  takes  the  form  of  a calculus  of  variations  or  mathe- 
matical programming  solution  to  a constrained  problem  with 
nonlinear  state  and  measurement  models.  This  is  a difficult 


and  computational  resource  - consuming  process;  and  modeling 
simplifications  must  be  made  and  alternative  computer  archi- 
tectures must  be  explored  to  implement  such  solutions  in  real 
time.  For  the  perturbation  control  function,  classical  frequency- 
domain  techniques  have  been  used  to  design  simple  analog  or 
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2.  RECOMMENDED  STUDY  AREAS 

Several  topics  addressed  in  this  report  present  themselves 
as  potentially  high  payoff  areas  for  further  research.  In 
general,  the  previous  work  reported  upon  is  theoretical  in 
nature  and  has  yet  to  be  developed  into  working  designs.  Such 
development  and  implementation  of  existing  theoretical  concepts 
is  a difficult  and  multifaceted  problem,  involving: 

(1)  thorough  understanding  of  theoretical  concepts 
so  that  any  approximations  or  assumptions  neces- 
sary to  make  the  concept  " imp lementab le"  can  be 
assured  to  be  valid;  and 

(2)  broad  expertise  with  state-of-the-art  computing 
systems  so  that  computational  resources  can  be 
efficiently  assigned  to  the  appropriate  proces- 
sing task  and  so  that  the  final  design  will  be 
well  integrated. 

Because  of  the  difficulties  anticipated  with  bringing  modern 
guidance  and  control  concepts  to  an  operational  stage,  it  is 
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recommended  that  future  research  emphasize  r_al-time  laboratory 
evaluation  and  in-flight  testing  in  the  development  and  valid- 
ation of  such  concepts.  Particular  recommended  study  topics 
are  enumerated  below. 


a.  Threat  Avoidance 


The  Air  Force  Flight  Dynamics  Laboratory  (FDL)  is  cur- 
rently funding  the  development  and  demonstration  of  a 4-D 
Integrated  Control  and  Display  System  (INCADS).  The  following 
advanced  flight  management  capabilities  are  to  be  provided  by 
the  4-D  INCADS  system: 

• Airborne  computer  synthesis  of  nonlinear  four- 
dimensional profiles  (3D  trajectories  plus  time) 

• A control  law  (with  automatic  and  manual  modes)  to 
track  the  synthesized  4-D  profiles 

• Miss  ion- oriented  information  displays  and  controls 

In  addition  to  endpoint  attainment,  the  4-D  profile  synthesis 
capability  is  being  used  to  avoid  military  threats,  traffic, 
obstacles,  and  weather.  Recent  work  has  been  directed  towards 
transport  aircraft;  the  emphasis  is  now  shifting  towards  fighter 
aircraft . 

As  discussed  in  Section  III,  the  state-of-the-art  in 
practical  control  theory  now  permits  much  more  comprehensive 
and  accurate  solutions  to  the  threat  avoidance  problem.  The 
advent  of  high-speed  parallel  processing  computer  systems  has 
made  feasible  the  onboard  implementation  of  trajectory  gener- 
ation algorithms  which  simultaneously  optimize: 

• probability  of  survival  for  both  completing  and 
aborting  the  mission  at  a particular  time 

• probability  of  accomplishing  numerous  mission 
objectives  (striking  targets,  etc.) 
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• strategy  for  deploying  both  expendable  and  non- 
expendable countermeasure  resources. 

Research  on  such  advanced  algorithms  may  prove  to  be  of  high 
potential  payoff,  particularly  for  the  case  of  fighter  aircraft 
on  missions  which  require  penetration  of  heavy  defenses. 


b.  Terrain  Following 

Modern  path- oriented  approaches  to  the  terrain- fol lowing 
problem  offer  many  options  to  the  system  designer.  These  in- 
clude : 

• how  to  incorporate  a priori  and  real - time  - col lected 
information  about  the  terrain  along  the  desired 
track 

• what  secondary  performance  objectives  (fuel  optimis- 
ation, throttle  activity  optimization,  etc.)  should 
be  addressed  by  the  reference  generation  algorithms 

• how  to  make  these  sophisticated  solutions  computable 
in  real  time. 

Design  techniques  already  exist  for  addressing  the  various 
aspects  of  the  problem,  but  these  have  yet  to  be  integrated  into 
a working  system.  The  design,  development,  and  demonstration  of 
such  an  integrated  system  are  worthwhile  research  objectives. 


c.  Advanced  Perturbation  Control 


Perturbation  control,  as  presented  in  this  report,  is 
an  integral  part  of  the  path-control  problem  as  associated  with 
any  research  performed  on  reference  generation  (e.g.,  the  threat 
avoidance  and  terrain- fol lowing  work  recommended  above).  Addi- 
tionally, future  work  should  be  directed  towards  inner  loop 
control  itself,  independent  of  reference  generation.  Such  work 


may  address  improved  autopilot  designs  or  the  feasibility  of 
active  control  concepts  (ride  smoothing,  gust-load  alleviation, 
etc . ) . 

A prerequisite  for  such  research  is  an  accurate,  high-fidelity 
mathematical  model  of  the  airframe  aerodynamics,  the  actuation 
system,  and  the  sensor  system.  These  models  must  be  tailored 
to  the  particular  vehicle  configuration  and  val idated  by  test 
data.  The  reduction  of  test  data  and  the  development  of  the 
math  models  is  greatly  facilitated  and  semi- automated  by  the  use 
of  any  of  a number  of  parameter  identification  techniques,  which 
basically  attempt  to  select  parameters  in  a prespecified  model 
structure  such  that  the  model  outputs  "fit"  the  test  data  in 
some  statistically  optimal  sense  (e.g.,  maximum  likelihood). 

Current  FDL  plans  for  instrumenting  the  KC-13SC  aircraft 
(Speckled  Trout)  are  consistent  with  the  information  require- 
ments of  advanced  parameter  identification  techniques.  In  view 
of  the  importance  of  this  aircraft  to  FDL  research  and  develop- 
ment efforts,  it  is  recommended  that  advanced  identification 
techniques  in  fact  be  applied  to  Speckled  Trout  flight  data, 
in  order  to  obtain  a validated  math  model  of  sufficient  fidelity 
to  support  all  anticipated  research  activities. 


APPENDIX 

MODELING  OF  AIRCRAFT  SYSTEMS  FOR  CONTROL  DESIGN 


A . 1 INTRODUCTION 


Mathematical  models  have  been  applied  widely  to  the  design  of 
aerospace  vehicle  control  systems.  Such  models  vary  broadly 
according  to  the  nature  of  the  particular  physical  process  (aero- 
dynamics, airframe  bending,  navigation  and  guidance,  etc.)  and 
the  specific  fidelity  requirements  imposed  on  the  model  by  the 
system  design  objectives.  This  appendix  highlights  a few  of  the 
many  modeling  and  approximation  techniques  which  are  normally 
applied  to  the  design  of  aircraft  guidance  and  control  systems. 

A. 2 SIX-DEGREE-OF-FREEDOM  (6  DOF)  AIRCRAFT  MODELS 


While  simple  point  mass  models  are  sufficient  for  many 
aircraft  performance  prediction  problems,  inner  loop  design 
(e.g.,  the  design  of  active  controls)  requires  the  fidelity 
of  a full  6 DOF  aircraft  model.  This  section  summarizes  some  of 
the  results  derived  in  [4],  Chapters  5 and  6.  For  a more  thorough 
treatment,  the  reader  is  referred  to  that  work. 


The  general  6 DOF  equations  of  motion  for  a rigid  body  derive 
from  Newton's  Law  and  the  moment  equation: 


(A.  1) 


G = 


dh 

dt 


(A.  2) 


where 

F 

resultant 

external 

center  of 

mass 

G 

resultant 

external 

center  of 

mass 

v 

velocity  vector  of 

force  vector  acting  on  the 
moment  vector  acting  about  the 
the  center  of  mass 
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h angular  momentum  vector 

m mass 

In  the  above  equations,  the  derivative  is  taken  in  the  space-fixed 
(inertial)  coordinate  frame.  Transforming  these  equations  from 
the  inertial  frame  to  one  rotating  with  a rate  and  rotation  axis 
given  by  w and  attached  to  the  body,  one  obtains 

6v 

F = m — + m(ojxv)  (A. 3) 

6 1 


G 


6h 

— = + wxh 
6 1 


(A. 4) 


where  the  derivative  ( 6 / 6 1 ) is  now  taken  in  the  rotating  body 
frame . 

The  external  force  vector  F is  the  sum  of  two  components,  the 
aerodynamic  forces  (including  propulsive  terms)  FA  and  a gravity 
term  F^,: 


F = 


£g 


(A.  5) 


In  conventional  aircraft  body  coordinates,  these  vectors  have  the 
components : 


X 

Y 

Z 


(A. 6) 


where 


Ig 


-mg  sin9 
+ m g cos0  sin$ 
+ m g cos0  cos<{> 


is  the  body  pitch  angle 

is  the  body  roll  angle 

is  the  acceleration  of  gravity 


(A. 7) 


9 

♦ 

g 


and  the  Euler  angle  sequence  from  inertial  to  body  coordinates  is 
assumed  to  be  yaw- pi tch - rol 1 {ti>,0,4>}.  Letting  the  components  of 
the  velocity  vector  be,  in  body  coordinates: 


v = 


u 

v 

(Jj 


(A. 8) 


and  letting  the  rotation  rate  of  the  body  with  respect  to  earth- 
fixed  coordinates  be,  in  body  coordinates: 


to  = 


P 

q 

r 


(A. 9) 


and  letting  the  rotation  rate  of  the  earth  with  respect  to  inertial 
(space- fixed}  coordinates  be 


a) 


(A. 10) 


one  can  write  the  force  equilibrium  equation  (A. 3)  in  component 
form: 

X - mg  sin0  * m [u  ♦ (qE+q) w - (rE  + r)  vj 

Y ♦ mg  cos0  sin<>  = m[v  + (rE>r) u - (p^+p)  wj 

Z ♦ mg  cos0  cos<|>  * m£w  + (pE+p)v  - (qE+q)u]  (A.  11) 

Equations  (A. 11)  can  be  simplified  by  means  of  the  flat-earth 

p 

approximation,  where  to  is  neglected  and  the  Earth  is  treated  as 

p 

a stationary  plane  in  inertial  space.  In  this  case,  the  terms  p , 

F E 

q and  r disappear  from  the  equations. 
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I 


Similarly,  one  can  write  the  moment  equation  in  component 

form: 


L = 

!y2(q2-r2) 

- Izx(r*pq) 

• IxyU-rp)  • 

(v 

lz)<*T 

M = 

V * 

Wr2V) 

- Ixy(p+qr) 

- iyz(f-pq)  - 

<V 

lx)rp 

N = 

V • 

!Xy(p2-q2) 

- IyzU  + rp) 

- IlxCp-qr)  - 

<v 

i y ) pq  (A. 12) 

where  the  external  moment  vector  has  been  expressed  in  its  body  axis 
components : 


L 


G ■ 


M 


N 


(A. 13) 


and  the  angular  momentum  components  and  their  derivatives  have 
been  expressed  in  terms  of  the  moments  of  inertia  I^j.  The  moment 
equation  (A. 12)  has  been  reduced  in  complexity  by  the  assumption 
that  "mean"*  inertia  axes  are  used,  that  the  inertia  matrix  is  con- 
stant (e.g.,  fuel  consumption  has  a negligible  effect  on  inertia), 
and  rotor  effects  (e.g.,  propeller)  are  negligible.  If  the  X-Z 
plane  is  a plane  of  symmetry,  as  is  usually  the  case  for  flight 
vehicles,  I = 1^,  = 0 and  Equations  (A. 12)  reduce  further: 

L = !XP  - Izx(r*pq)  ' Uy-Iz)qr 

M = 1 y^  * I2x(r~'p")  * (Iz_Ix)rp 

N = I,r  * !zx(p-qr)  - ( I x - I y ) pq  (A. 14) 


* Mean  axes  are  those  body  axes  for  which  the  angular  momentum 
vector  is  not  affected  by  distortion  effects,  such  as  elastic 
deformation,  the  motion  of  hinged  parts,  or  the  sloshing  of 
fuel . 
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Using  the  flat-earth  approximation,  Eqs.  (A. 11)  and  (A. 14) 
can  be  written  in  the  state-space  structure: 


i j~X  - m g sin0  ♦ r v - q WJ 

— [y  ♦ m g co s 0 sin$  + p w - r uj 

jjj  £z  ♦ m g cos0  co s<p  * q u - p vj 


L - qr(I2-Iy)  + Ix,pq  + |N  - pq(Iy-Ix) 


!xz  qr 


• JS1  1 1 . ) 

Iz  / \ x I z I 

• M ,2  2^  *xz  _ *z^ 

q = — + (r  -p  ) pr  

y ly  Ly 

f = N - pq(Iy-Ix)  - Ixzqr  ♦ | L+qr  ( Iy- 1 ,)  - Ix,  pq  } 

' T1}  / K*tH 


These  six  equations  can  be  expressed  in  vector  form: 


x » f (x , F , G) 


by  defining  the  state  vector: 


it 


Linear  Model 


For  many  reasons,  it  is  common  practice  to  "linearize" 

Equation  (A. 16)  by  assuming  equilibrium  (trim)  conditions  exist 
and  examing  small  disturbances  (perturbations)  about  this  equilib- 
rium. The  application  of  this  small  disturbance  theory  leads  to 
the  general,  coupled,  linearized  model  of  aircraft  motion  referred 
to  steady- state , rectilinear  flight.  In  the  linearized  equations, 
the  components  of  the  external  forces  F and  moments  G are 
"expanded"  into  linear  expressions  in  the  state  perturbation  vari- 
ables; the  coefficients  of  the  linear  expansion  are  the  "stability 
derivatives . " 

These  linearized  equations  are  then  usually  "decoupled"  into 
longitudinal  and  lateral  axes  by  making  several  assumptions.  The 
existence  of  "pure"  (uncoupled)  longitudinal  motion  depends  on 
only  three  assumptions  (in  addition  to  the  linearization  assump- 
tions) : 

(1)  The  flat-earth  approximation 

(2)  The  existence  of  a plane  of  symmetry 

(3)  The  absence  of  rotor  gyroscopic  effects 

The  existence  of  the  uncoupled  lateral  motions,  however,  depends 
upon  more  restrictive  conditions;  namely,  those  above  plus 
the  neglect  of  all  aerodynamic  cross  - coup  1 ing  terms  (which 
may  not  be  strictly  zero). 

The  resulting  linear  equation  in  parametric  form  will  not 
be  reiterated  here.  For  detailed  development,  the  reader  is 
referred  to  Ref.  4,  Section  5.10  and  following,  or  to  another 
flight  dynamics  book. 
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A. 3 POINT -MASS  AIRCRAFT  MODELS 


Point  mass  aircraft  models  are  highly  desirable  for  designing 
outer- loop  control  laws  (.navigation/guidance,  trajectory  generation) 
because  of  their  simplicity.  Point-mass  models  are  also  used  ex- 
tensively in  aircraft  design  to  predict  performance  capabilities. 
Such  models  are  based  on  force  and  moment  equilibrium,  geometry, 
and  basic  aerodynamics. 

For  illustration,  the  point  mass  model  for  aircraft  motion  in 
the  vertical  plane  will  be  presented.  Figure  A.l  shows  the  nomen- 
clature commonly  used  for  this  vert  ical -plane , point-mass  model. 

As  shown,  the  "wind-axis"  (w)  system  is  being  used  as  reference; 
wind  axes  are  defined  by  the  x-axis  into  the  relative  wind  and  the 
z-axis  opposing  the  lift  vector. 


un 


Figure  A.l  Forces  in  the  Aircraft  Plane  of  Symmetry 

In  the  rotating  wind-axis  coordinate  frame,  the  x and  z 
acceleration  components  are  given  by  (assuming  stationary  atmos- 


where  V is  the  magnitude  of  the  velocity  relative  to  the  air  and 
Y is  the  flight  path  angle.  Force  equilibrium,  then,  leads  to 
the  following: 


mV  * T cosa  - D - mg  siny  (A. 20) 

mV Y = T sina  + L - mg  cos y (A. 21) 

and  the  position  equations  can  be  written  from  geometry: 

li-Vsiny  (A. 22) 

x = V cos  ^ (A. 23) 


In  the  above  equations,  a is  the  angle-of-attack , T is  the 
thrust,  L is  the  lift,  and  D is  the  drag.  Equations  (A. 20) 
(A. 23)  can  be  written  in  state  space  form  by  defining  the  state 
vector : 


(A. 24) 


The  remainder  of  this  Appendix  illustrates  some  additional 
approximations  which  are  often  made  in  the  design  of  control  sys- 
tems to  maximize  performance. 

Quasi-Steady  Approximation 

Performance  analysis  of  subsonic  aircraft  can  frequently  uti- 
lize the  quasi-steady  approximation,  where  accelerations  are 
neglected  in  Equations  (A. 20)  and  (A. 21),  which  become: 

0 = T(V,h)cosa  - D(a,V,h)  - mg  sinY  (A. 25) 

0 = T(V,h)sina  + L(a,V,h)  - mg  cosY  (A. 26) 
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Now,  for  example,  to  determine  the  value  of  a*  which  maximizes 
the  rate  of  climb  at  a given  altitude,  one  optimizes  the  expression 
for  rate  of  climb  (Eq.  (A. 22)): 

h = rate-of -climb  = VsinY  (A. 27) 


subject  to  the  constaints  given  by  (A. 25)  and  (A. 2b).  That  is, 
one  finds  the  value  of  a which  optimizes  the  Hamiltonian  H : 


where 


H = 


V siny  + A^(T  cosa  - D - mg  sina) 

+ A-,(T  sina  + L - mg  cosa) 
are  the  lagrange  multipliers  (see  Section 


(A. 28) 


2.3.1) 


Energy  State  Approximation 

The  energy  state  approximation  [18]  replaces  V in  Eq . 

(A. 20)  by  energy  per  unit  mass  E as  a state  variable,  where 
E is  the  sum  of  kinetic  and  potential  energy: 

E = 1/2  V2  + gh  (A. 29) 

The  time  rate  of  change  of  E is  found  by  differentiating: 

E « VV  + gh  (A. 30) 

and  using  Equation  (A. 20)  to  eliminate  V and  Equation  (A. 22)  to 
eliminate  h : 

E = V (Tcosa  - D)/m  (A. 31) 

The  approximation  goes  on  to  make  the  following  additional  assump- 
tions: 


* . 

i.e.,  a is  being  used  as  a control  variable  in  this  outer-loop 
problem 


(1)  acceleration  normal  to  the  flight  path  (Vy)  is  neglected; 

(2)  flight  is  nearly  horizontal  (cosy  = 1); 

(3)  the  component  of  thrust  normal  to  the  flight  path 
(T  sina)  is  neglected  and  cosa  = 1. 

With  these  assumptions,  Equation  (A. 21)  reduces  to: 

L (oc , V , h)  = mg  (A.  32) 

which  may  then  be  used  to  determine  a in  terms  of  V and  h : 

a = a(V,h)  (A. 33) 

The  altitude  h may  also  be  expressed  in  terms  of  V and  the 
state  E using  Equation  (A. 29): 

h = (E  - 1/2  V2)/g  (A. 34) 

This  permits  final  summary  of  the  energy  state  approximation: 

Using  the  energy  state  approximation,  performance  optimiza- 
tion may  be  addressed  by  considering  a single  state  variable : 

E = V(T-D)/m  (A. 35) 

and  V may  be  considered  as  the  control  variable,  because 
both  a and  h can  be  expressed  as  a function  of  V 
(Equations  (A. 33)  and  (A. 34)). 


108 


REFERENCES 


Meyer,  G.  and  Cicolani,  L. , "A  Formal  Structure  for  Advanced 
Automatic  Flight  Control  Systems,"  NASA  TN  D-7940,  May  1975. 

Bird,  D.  and  Neighbor,  T.  (Air  Force  Flight  Dynamics  Labor- 
atory) - "Decoupling  Control  Technology  for  Medium  STOL 
Transports,"  NASA  TM  X-3409,  August  1976. 

Vincent,  James  H. , "STOL  Tactical  Aircraft  Investigation  — 
Flight  Control  Technology:  Piloted  Simulation  of  a Medium 
STOL  Transport  with  Vectored  Thrust/Mechanical  Flaps," 
AFFDL-TR- 73- 19 , Volume  V,  Part  II,  May  1973. 

Etkin,  B. , Dynamics  of  Atmospheric  Flight,  John  Wiley  and 
Sons,  1972. 

Athans , M.  , "The  Role  and  Use  of  the  Stochastic  Linear- 
Quadratic-Gaussian  Problem  in  Control  System  Design," 

IEEE  Transactions  on  Automatic  Control:  Special  Issue  on 
the  Linear-Quadratic-Gaussian  Problem,  Vol.  AC- 16,  No.  6, 
December  1971. 

Athans,  M.  and  Falb,  P.,  Optimal  Control:  An  Introduction 
to  the  Theory  and  Its  Applications,  McGraw-Hill  Book  Company, 
Mew  York,  1 96 6 . 

Kokotovic,  P.  , O'Malley,  R.  , and  Sannuti,  P.  , "Singular 
Perturbations  and  Order  Reduction  in  Control  Theory  --  An 
Overview,"  Automatica , Vol.  12,  pp.  123-152,  Reprint  1976 
by  Permagon  Press,  (Treat  Britain. 

Calise,  A.,  "Singular  Perturbation  Methods  for  Variational 
Problems  in  Aircraft  Flight,"  IEEE  Transactions  on  Automatic 
Control , Vol.  AC- 21,  No.  3,  June  1976  , pp.  345- 553. 

Davison,  E. , "A  Method  for  Simplifying  Linear  Dynamic 
Systems,"  IEEE  Transactions  on  Automatic  Control,  Vol.  AC-11, 
pp.  93-100,  1966. 

De  Hoff,  R.  , Hall,  W.E.,  Adams,  R.  , and  Gupta,  N.  , "F100 
Multivariable  Control  Synthesis  Program  --  Vol.  1 Design 
Methodology,"  Systems  Control,  Inc.  (Vt)  Report  to  AFAPL 
under  Contract  F33615- 75-C-  2053 , January  1977. 

Rogers,  R.  and  Sworder,  D.  , "Suboptimal  Control  of  Linear 
Systems  Derived  from  Models  of  Lower  Dimension,"  AIAA 
Journal,  August  1971,  pp.  1461-1467. 


r 


12.  Skelton,  R. , "Cost-sensitive  Model  Reduction  for  Control 
Design,"  AIAA  Paper  78-1282,  Guidance  and  Control  Confer- 
ence, Palo  Alto,  CA,  August  1978. 

13.  van  Woerkom,  P.Th.L.M. , "Survey  of  Modern  Control  and 
Observation  Theory  for  Disturbed,  Target  Following  Aero- 
space Systems,"  National  Aerospace  Labora  >rv.  The  Nether- 
lands, Report  NLR-TR-76041-U,  March  1976. 

14.  Bryson,  A.  and  Ho,  Y.C.,  Applied  Optimal  Control,  Blaisdell 
Publishing  Co. , Waltham,  Mass . , 1969 . 

15.  Pontryagin,  L. , et  al..  The  Mathematical  Theory  of  Optimal 
Processes , Interscience  Publishers , John  Wiley  and  Sons, 

New  York,  1962. 

16.  Jacobson,  D.  and  Mayne , D. , Differential  Dynamic  Program- 
ming , New  York:  Elservier,  1970. 

17.  Sage,  A.,  Optimum  Systems  Control,  New  Jersey:  Prentice- 
Hall,  Inc. , 1968. 

18.  Bryson,  A.,  Desai,  M. , and  Hoffman,  W. , "Energy- State 
Approximation  in  Performance  Optimization  of  Supersonic 
Aircraft,"  Journal  of  Aircraft,  Vol.  6,  No.  6,  November- 
December,  1969,  pp. 481-488. 

19.  Calise,  A.,  "Extended  Energy  Management  Methods  for  Flight 
Performance  Optimization,"  AIAA  Journal  , Vol.  15,  No.  3, 

March  1977,  pp. 314-321. 

20.  Uehara,  S. , Stewart,  H. , and  Wood,  L. , "Minimum-Time  Loop 
Maneuvers  of  Jet  Aircraft,"  Journal  of  Aircraft,  Vol.  15, 

No.  8,  August  1978,  pp. 449-485. 

21.  Calise,  A.,  "Singular  Perturbation  Methods  for  Variational 
Aircraft  Flight,"  IEEE  Trans.  Auto.  Cont.,  Vol.  AC-21, 

No.  3,  June  1976,  pp . 345-353. 

22.  Hedrick,  J.  and  Brvson,  A.,  "Three-dimensional  Minimum-Time 
Turns  for  a Supersonic  Aircraft,"  Journal  of  Aircraft, 

Vol.  9,  pp.  115-12;,  February  1972. 

23.  Bryson,  A.  and  Hedrick,  J.,  "Three-dimensional  Minimum-Fuel 
Turns  for  a Supersonic  Aircraft,"  Journal  of  Aircraft,  Vol.  9, 
pp. 223-229,  March  1972. 


no 


24.  Hedrick,  J.  and  Bryson,  A.,  "Minimum- Time  Turns  for  a 
Supersonic  Airplane  at  Constant  Altitude,"  J.  Aircraft, 

Vol . 14,  No.  8,  August  1977,  pp. 182-187. 

25.  Erzberger,  H.  and  Lee,  H. , "Optimum  Horizontal  Guidance 
Techniques  for  Aircraft,"  J . Aircraft,  Vol.  8,  No.  2, 
February  1971,  pp. 95-101. 

26.  karmarkar,  J.,  "Automated  RNAV/MLS  Transition  --  An  Avi- 
onics Sensitivity  Studv,  Vol.  Ill,"  NASA-CR- 145109 , March 
1977. 

27.  Lee,  H. , McClean,  J.,  and  Erzberger,  H.  , "Guidance  and 
Control  Techniques  for  Automated  Air  Traffic  Control," 

J . Ai rcraft , Vol.  9,  No.  7,  July  1972,  pp. 490-496. 

28.  Marsh,  J.  and  Grossberg,  M. , "Research  Report  for  the 
Advanced  Weapons  Management  System  (AWMS) ,"  Systems 
Control,  Inc.  Report  to  the  Navy,  Pacific  Missile  Test 
Center  under  Contract  N00 1 23 - 77 -C - 06 33 , June  1978. 

29.  Shultz,  R.  and  Kilpatrick,  P. , "Aircraft  Optimum  Flight 
Paths,"  JANAIR  Report  700709,  June  1970. 

30.  Erzberger,  H.  and  Lee,  H. , "Characteristics  of  Constrained 
Optimum  Trajectories  with  Specified  Range,"  NASA  TM  78519, 
September  1978. 

31.  Funk,  J.,  "Optimal-Path  Precison  Terrain - Fo 1 lowing  System," 
J . Aircraft , Vol.  14,  No.  2,  February  1977,  pp. 128-154. 

32.  Funk,  J.  and  Breza,  M. , "An  Integrated  System  for  Thrust 
and  Path  Control  During  Terrain  Following,”  to  be  published. 

35.  Trankle,  T.  and  Bryson,  A.,  "Autopilot  Logic  for  the  Flare 
Maneuver  of  STOL  Aircraft,"  Stanford  University  SUDAAR 
Report  No.  494,  May  1975. 


Ill 

*U.S. Government  Printing  Office  1979  657-002/431 


